Digitally enhanced microscopy for multiplexed histology

ABSTRACT

Disclosed herein are embodiments of imaging biological specimens. An imaging system can include a microscope for directly viewing the biological specimen and a multi-spectral imaging apparatus for outputting digitally enhanced images, near-video rate imaging, and/or videos of the specimen. An imaging system can include a digital scanner that digitally processes images to produce a composite image with enhanced color contrast of features of interest.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. application Ser. No.14/027,093, filed Sep. 13, 2013 (U.S. Pat. No. 10,778,913), which claimsthe benefit of U.S. Provisional Patent Application No. 61/778,093, filedMar. 12, 2013, which are incorporated herein by reference in theirentireties.

FIELD OF TECHNOLOGY

The present disclosure concerns contrast enhanced microscopy forhistology. In particular, the present technology is related tomicroscopy and digital enhancement, color reclassification, and/ordigital processing of images/video of specimens.

BACKGROUND

Immunohistochemistry (IHC) generally refers to the process of detecting,localizing, and quantifying antigens, such as a protein, in a biologicalsample and using specific binding moieties, such as antibodies specificto the particular antigens. In situ hybridization (ISH) generally refersto the process of detecting, localizing, and quantifying nucleic acids.Both IHC and ISH can be performed on various biological samples, such astissue (e.g., fresh frozen, formalin fixed paraffin embedded) andcytological samples. Upon recognition of targets, whether the targets benucleic acids or antigens, the recognition event can be detected throughthe use of various labels (e.g., chromogenic, fluorescent, luminescent,radiometric, etc.). For example, ISH on tissue can include detecting anucleic acid by applying a complementary strand of nucleic acid to whicha reporter molecule is coupled. Visualization of the reporter moleculeallows an observer to localize specific DNA or RNA sequences in aheterogeneous cell population, such as a histological, cytological, orenvironmental sample. ISH techniques can include, for example, silver insitu hybridization (SISH), chromogenic in situ hybridization (CISH) andfluorescence in situ hybridization (FISH). It may be difficult toidentify very small stained samples. In some clinical readings, labelsmay be near the optical resolution limit of the microscope, therebylimiting the user's ability to resolve slight differences in colorand/or overlap of multiple hybridization signals. In a clinical readingusing a microscope, pathologists often report a score for the biologicalsample by visually inspecting cells or cell components (e.g., proteins,lipids, etc.) that are stained different colors. Unfortunately, it maybe difficult to perceive some stains and/or to differentiate betweenstained features. Additionally, color perception can vary betweenpathologists. A pathologist with less acute vision may have difficultyin differentiating between colors, which may result in inconsistentscoring between pathologists.

Multiplexing histological techniques can be used to evaluate a number ofbiomarkers in IHC and ISH. However, an observer's color perception oftenlimits the number of chromogens or fluorophores that can be usedsimultaneously, thereby limiting assay multiplexing. In chromogenicmultiplexing using bright field microscopes, it may be difficult tovisually detect different color chromogens because the chromogens mayhave relatively broad spectra. Even with narrower band absorbers,spectra overlap between different chromogens can result in dark spotsthat provide limited perception of color. Variations in staining betweenspecimens can further increase difficulty in accurately differentiatingbetween different color chromogens. Additionally, some colors are harderto distinguish than others. Yellows and cyans generally provide lesscontrast because they absorb light at the blue or red edge of the visualspectrum such that the percentage of total detectable light absorbed isrelatively small relative to, for example, a green light absorber,resulting in yellow and cyan chromogens exhibiting lower visual contrastrelative to magenta chromogens. Chromogenic absorbers outside of thevisual spectrum can be used to increase multiplexing but cannot beviewed using a traditional bright field microscope. In fluorescencedetection, fluorescent labels may not be equally detected by differentobservers due to the fluorescent label emissions being on the fringes oroutside of the visual spectrum. Thus, the level of assay multiplexing isoften limited, and assay multiplexing has significant drawbacks.

SUMMARY

At least some embodiments are imaging systems for directly viewingstained biological specimens and outputting digitally enhanced imagesand/or video of the specimens. The imaging systems can includemicroscopes for directly viewing the specimen and multi-spectral imagingapparatuses. A user can view through ocular(s) of the microscope torapidly locate region(s) for inspection and/or to locate specificfeatures of interest, such as chromogen-stained features,fluorophore-stained features, or other features for IHC, ISH, or otherinspection techniques. Image(s) and/or video of the specimen can beoutputted in real-time on a display of the imaging apparatus locatednext to the microscope. The image(s) and/or video can be digitallyenhanced to facilitate identification of stained features. Byalternating between bright field viewing (e.g., viewing via themicroscope) and viewing digitally enhanced image(s)/video, a user canrapidly and accurately score the specimen. The imaging systems canprovide digital enhancement, color reclassification, spectraldeconvolved image(s)/video, and/or digital processing of image/video.

In some embodiments, a stage of the microscope can be moved in the X, Y,and Z (focus) directions and the imaging apparatus can output video (orimages at a near-video rate) to minimize, limit, or substantiallyeliminate delays associated with displaying the images and/or video. Inone embodiment, an image capture device of the imaging system can becoupled to a compound microscope. In other embodiments, the imagingapparatus can be incorporated into or be part of a digital microscope.The digital microscope may or may not have oculars for direct viewing ofthe biological specimen and a display for outputting digitally enhancedimage(s)/video.

The imaging system can include one or more image capture devices andenergy emitters, such as light sources, infrared sources, ultravioletsources, or the like. Light sources can be light-emitting diodes (LEDs)that are pulsed on and off to correspond with imaging frames such thatsuccessive frames are recorded with a different LED illumination. TheLEDs can produce light that corresponds to the absorbance of eachchromogen used to stain the specimen and, in some embodiments, may limitthe contribution from spectrally neighboring chromogens. Digitalprocessing can be used to re-define the spectral characteristics ofcaptured images such that features of interest are optimally perceivedby the observer. For example, color re-definition and/or contrastenhancement of each LED's illumination can be performed to bettervisually distinguish each chromogen and to adapt to the acuity of theobserver. In some embodiments, digital processing darkens areascorresponding to features of interest and can lighten other areas.Additionally, colors can be redefined to further enhance visual and/orautomated identification of features of interest. In some embodiments,the imaging apparatus is a filterless imaging apparatus with an imagecapture device that outputs images based on specific wavelength(s)and/or waveband(s) from an illuminator.

In some embodiments, the image capture device provides multispectralimages. Spectral unmixing can be performed on the images. The colors ofthe unmixed images can be re-defined to provide optimal colorseparation. In one embodiment, the redefined images can be combined toproduce color composite images (e.g., false color composite images). Toincrease multiplexing capability, the image capture device can providesensitivity outside the visual spectrum range to image chromogens and/orfluorescence signals outside the visual spectrum. The image capturedevice can be configured to provide re-focusing capability due to, forexample, chromatic aberrations associated with UV and near IR energysources. In one embodiment, an automated focus device or an automatedfocus stage can be used to adjust focus in synchrony with theilluminator. For example, the automated focus device can be incorporatedinto the image capture device. Alternatively or additionally, anautomated focus stage can adjust focus for visible light emitters, UVenergy emitters, and IR energy emitters. Fluorescent stains that arebright enough for video or near video rate imaging can be excitedselectively and sequentially with different pulsed LEDs synchronizedwith image recording. Amplification methods, such as tyramide depositionof fluorophores, can be used to render specimen fluorescencesufficiently intense for video rate or near video rate imaging.

In some embodiments, an imaging system can include an image capturedevice coupled to or near the eyepiece of a compound microscope. Inother embodiments, the microscope can be a digital microscope with anintegrated image capture device. In yet other embodiments, the imagingsystem can be used with a stereo microscope or other type of microscopeused for viewing very small objects at, for example, several hundredtimes magnification. The position of an illuminator and the imagecapture device of the imaging system can be selected based on theconfiguration of the microscope. The imaging systems can further includea processing device in the form of a desktop computer, a laptopcomputer, a tablet, or the like and can include digital electroniccircuitry, firmware, hardware, memory, a computer storage medium, acomputer program, a processor (including a programmed processor), or thelike.

In some further embodiments, an imaging system is configured to image aspecimen located on a microscope slide and comprises an imagingapparatus, one or more lenses, and a display in communication with theimaging apparatus. The imaging apparatus includes an energy emitter inthe form of an illuminator having a plurality of different color lightsources that sequentially produce light for sequentially illuminating atleast a portion of the specimen. The imaging apparatus also includes animage capture device positioned to capture a plurality of specimenimages each corresponding to the specimen being exposed to light from arespective one of the light sources. A processing device is configuredto produce contrast enhanced color image data based on the specimenimages. The display can be configured to display the specimen based onthe contrast enhanced color image data. The display can display falsecolor images or false color video of the specimen. Other types of output(e.g., patient information, stain information, reports, etc.) can alsobe displayed. In some embodiments, the display displays contrastenhanced color output (e.g., false color composite image/video) and/orspectral unmixed output that provides greater color contrast betweentargeted cell structures than the naturally-occurring color contrastprovided by bright field viewing. The processing device can output thecontrast enhanced color data such that the contrast enhanced coloroutput is video of the specimen displayed at a frame rate equal to orgreater than a desired frame rate (e.g., 2 frames/second).

The energy emitter, in some embodiments, is configured to produce energyemissions with mean wavelengths that are different from one another. Inone embodiment, the total number of different energy emissions (i.e.,energy emissions with different mean wavelengths) is in a range of about4 to 8, for example. The energy emitter can include, without limitation,four light sources of different mean wavelengths, five light sources ofdifferent mean wavelengths, or ten or more light sources of differentmean wavelengths. The number of energy emissions, characteristics of theemissions (e.g., mean wavelengths), and/or number of light sources canbe selected based on the number of features of interest, types oflabels, etc.

The imaging system, in some embodiments, further includes a microscopecomprising a holder device carrying the microscope slide and one or moreoculars through which a user is capable of viewing the specimen whilethe display displays the contrast enhanced color output of the specimen.The illuminator can illuminate the portion of the specimen within themicroscope field. When using ocular(s), the illuminator can generatewhite light for normal appearance of the specimen. While the illuminatoroutputs white light, the contrast-enhanced color output may not beupdated in real-time.

In some further embodiments, a system comprises an imaging apparatus,one or more lenses, and display means in communication with the imagingapparatus. The imaging apparatus includes means for sequentiallyemitting energy and means for capturing an image/video. In someembodiments, the means for capturing is positioned to capture specimenimages, each corresponding to the specimen being exposed to energy. Insome embodiments, the means for capturing can include one or morecameras positioned on a front side and/or a backside of the microscopeslide carrying the biological specimen. The display means, in someembodiments, includes a monitor or a screen. In some embodiments, themeans for sequentially emitting energy includes multiple energyemitters. Each energy emitter can include one or more IR energyemitters, UV energy emitters, LED light emitters, combinations thereof,or other types of energy emitting devices. The imaging system canfurther include means for producing contrast enhanced color image databased on the specimen images captured by the means for capturing. Thedisplaying means displays the specimen based on the contrast enhancedcolor image data.

In yet other embodiments, a computer-based imaging system for imaging aspecimen located on a microscope slide comprises memory and aprogrammable processor. The memory can store a sequence of programinstructions. In some embodiments, the processor has circuitryconfigured to execute the instructions to cause the programmableprocessor to receive a first image of the specimen exposed to light at afirst wavelength/waveband for interacting with at least one firstfeature of interest and to receive a second image of the specimenexposed to light at a second wavelength/waveband for interacting with atleast one second feature of interest. The second wavelength/waveband canbe different from the first wavelength/waveband, respectively. Theinstructions can also cause the processor to generate a color image ofthe specimen based on the first and second images.

The memory, in some embodiments, stores converting instructionsexecutable by the circuitry. For example, converting instructions can beexecuted to convert the first image to a first false color image and toconvert the second image to a second false color image. The first andsecond false color images can be combined to produce a color compositeimage. Linear mixing methods, non-linear mixing methods, and/or othermixing techniques can be used to combine imaging. Features of interestin the composite image can be targets (e.g., nucleic acids, antigens,etc.), labels (e.g., chromogenic labels, fluorescent labels, luminescentlabels, radiometric labels, etc.), or various cell components orstructures. Additional false color images can be generated. In someprotocols, a total of 4-8 false color images can be generated to produceeach color composite image.

In some embodiments, a method for imaging a specimen carried by amicroscope slide includes capturing a first image of the specimen whilethe specimen is exposed to light at a first peak wavelength or a firstwaveband. The first peak wavelength or first waveband corresponds to afirst absorption wavelength or a first absorption waveband of firstfeatures of interest of the specimen. A second image can be capturedwhile the specimen is exposed to light at a second peak wavelength or asecond waveband. The second peak wavelength or second waveband cancorrespond to a second absorption wavelength or a second absorptionwaveband of second features of interest of the specimen. An image can begenerated based on the first and second images. In some embodiments, thegenerated image is a false color image (e.g., a composite image) orother types of enhanced image. The method, in some embodiments, includesconverting the first image into a first false color image, convertingthe second image into a second false color image, and combining thefirst and second false color images. The first and second images can bespectrally discrete images, such as monochrome images.

In yet another embodiment, a method for contrast enhanced imagingcomprises sequentially exposing at least a portion of a specimen (e.g.,a portion of the specimen within a microscope's field of view, theentire specimen, etc.) to light from light sources. Each light sourcecan output a mean wavelength capable of being absorbed by respectivefeatures of interest of the specimen. Images of the specimen can becaptured at each illumination step. False color image data can begenerated based on the captured images such that the false color datarepresents a false color image with enhanced color contrast betweendifferent features of interest of the specimen.

In some embodiments, an imaging system can capture images of a specimencarried by a microscope slide. During the image capturing process, thespecimen can be exposed to energy such that characteristics of thespecimen's features of interest vary between the images. The images canbe digitally processed and combined to produce an image for viewing. Inone embodiment, the captured images can be converted into false colorimages and combined to provide a composite false color image. In oneembodiment, a classifier can be used to determine the number and typesof stains applied to the specimen. The images can be processed based oninformation from the classifier.

The foregoing and other objects, features, and advantages of embodimentsof the invention will become more apparent from the following detaileddescription, which proceeds with reference to the accompanying figures.

BRIEF DESCRIPTION OF THE DRAWINGS

The patent or application file contains at least one drawing executed incolor. Copies of this patent or patent application publication withcolor drawing(s) will be provided by the Office upon request and paymentof the necessary fee.

FIG. 1 is a front view of an imaging system for imaging a specimenlocated on a microscope slide in accordance with an embodiment of thedisclosed technology.

FIG. 2(A) shows a digitally enhanced image of a biological specimen inaccordance with an embodiment of the disclosed technology.

FIG. 2(B) shows a bright field photomicrograph of the biologicalspecimen of FIG. 2(A).

FIG. 3 is a front view of a microscope and components of amulti-spectral imaging apparatus coupled to the microscope in accordancewith an embodiment of the disclosed technology.

FIG. 4 is a flowchart of a method for producing a digital image of aspecimen in accordance with an embodiment of the disclosed technology.

FIGS. 5(A-E) show human tissue stained for identifying non-Hodgkin'sKi-positive large cell lymphoma. FIGS. 5(A-D) are black-and-whitephotomicrographs of the human tissue illuminated by color LEDs. FIG.5(E) is a false color composite image of the tissue.

FIG. 6 shows an enhanced pseudoflourence image of human tissue stainedfor identifying non-Hodgkin's Ki-positive large cell lymphoma inaccordance with an embodiment of the disclosed technology.

FIG. 7 is a plot of wavelength versus absorption for various stains.

FIG. 8 illustrates a computer-based system for analyzing tissuespecimens in accordance with an embodiment of the disclosed technology.

FIG. 9 is a flowchart for detecting a target in accordance with anembodiment of the disclosed technology.

FIGS. 10(A-B) are schematic diagrams of two signaling conjugates. FIG.10(A) illustrates a signaling conjugate comprising a latent reactivemoiety and a chromophore moiety. FIG. 10(B) illustrates an alternativesignaling conjugate further comprising a linker.

FIGS. 11(A-F) are schematic diagrams illustrating a manner in which atarget on a sample is detected. FIG. 11(A) shows a detection probebinding to the target. FIG. 11(B) shows a labeling conjugate binding tothe detection probe. FIG. 11(C) shows a signaling conjugate beingenzymatically deposited onto the sample. FIG. 11(D) shows an alternativeembodiment in which an antibody-based detection probe is used to detecta different target. FIG. 11(E) shows an approach for detecting a targetusing an amplifying conjugate. FIG. 11(F) shows that the amplifyingconjugate was bound to the sample and was labeled with a secondarylabeling conjugate.

FIGS. 12(A-B) are schematic diagrams illustrating (A) a cross-sectionaldepiction of distribution of labeling conjugates proximally to target(T) and (B) a graph depicting the relationship between power of incidentradiation (P₀) across the sample shown in (A) and power of transmittedradiation (P) through the sample, the y-axis representing radiationpower and the x-axis representing linear distance across the sample.

FIGS. 13(A-B) are schematics showing the differences between signalsobtained with chromogens and signals obtained with fluorophores. FIG.13(A) illustrates detection of a chromogen wherein the transmitted lightis detected. FIG. 13(B) illustrates the detection of a fluorophorewherein the emitted light is detected.

FIGS. 14(A-B) are images illustrating the color characteristicsdiscussed herein. FIG. 14(A) is a color wheel depicting the relationshipbetween an observed color, and FIG. 14(B) is an image of absorbedradiation for signaling conjugates.

FIG. 15(A) is a graph illustrating the absorption spectrum of a5-TAMRA-tyramide conjugate, and FIG. 15(B) is a photomicrographillustrating a biological sample having targets detected by5-TAMRA-tyramide conjugate.

FIG. 16(A) is a photomicrograph of a dual stain of two gene probes on alung tissue section testing for ALK rearrangements associated withnon-small cell lung cancer, and FIG. 16(B) is a UV-Vis spectra of fastred and fast blue in ethyl acetate solutions as well as traces obtainedfrom tissue samples.

FIGS. 17(A) and 17(B) are graphs of wavelength versus absorbance andillustrate the two sets of traces. FIG. 17(A) illustrates the tracesobtained from tissue samples, whereas FIG. 17(B) illustrates tracesobtained from ethyl acetate solutions of Fast Red and Fast Blue.

FIGS. 18(A-B) are images and a schematic illustrating the differencebetween a dual ISH chromogenic detection, where FIG. 18(A) shows aSISH/Red combined detection protocol and FIG. 18(B) shows a purple andyellow signaling conjugate as described herein. The signal produced bycombining these two chromogens is detected as a third, unique color.

FIGS. 19(A-B) are photomicrographs showing two examples of depositingtwo colors proximally to create a visually distinct third color.

FIGS. 20 (A-C) are photomicrographs showing the use of LED illuminationto separate the signal from a chromogenic dual stain. FIG. 20(A) showswhite light illumination, FIG. 20(B) shows green light illumination, andFIG. 20(C) shows red light illumination.

FIGS. 21(A-B) are photomicrographs showing FIG. 21(A) a control slide towhich no BSA-BF was added and FIG. 21(B) a slide to which the BSA-BF hadbeen attached to the sample.

FIGS. 22(A-B) are photomicrographs showing a sample stained with asignaling conjugate FIG. 22(A) without tyrosine enhancement and FIG.22(B) with tyrosine enhancement.

FIGS. 23(A-B) are photomicrographs showing a HER2 (4B5) IHC in Calu-3xenografts stained with two different signaling conjugate.

FIG. 24 illustrates absorbance spectra of two signaling conjugates insolution and as used to stain the samples shown in FIGS. 23(A-B).

DETAILED DESCRIPTION I. Definitions and Abbreviations

Unless otherwise noted, technical terms are used according toconventional usage. Definitions of common terms in molecular biology maybe found in Benjamin Lewin, Genes VII, published by Oxford UniversityPress, 2000 (ISBN 019879276X); Kendrew et al. (eds.), The Encyclopediaof Molecular Biology, published by Blackwell Publishers, 1994 (ISBN0632021829); and Robert A. Meyers (ed.), Molecular Biology andBiotechnology: a Comprehensive Desk Reference, published by Wiley, John& Sons, Inc., 1995 (ISBN 0471186341); and other similar references.

As used herein, the singular terms “a,” “an,” and “the” include pluralreferents unless context clearly indicates otherwise. Similarly, theword “or” is intended to include “and” unless the context clearlyindicates otherwise. The term “includes” is defined inclusively, suchthat “includes A or B” means including A, B, or A and B. It is furtherto be understood that all nucleotide sizes or amino acid sizes, and allmolecular weight or molecular mass values, given for nucleic acids orpolypeptides or other compounds are approximate, and are provided fordescription. Although methods and materials similar or equivalent tothose described herein can be used in the practice or testing of thepresent disclosure, suitable methods and materials are described below.

In case of conflict with the disclosure of publications, patentapplications, patents, and other references mentioned herein, thepresent specification, including explanations of terms, will control. Inaddition, the materials, methods, and examples are illustrative only andnot intended to be limiting.

Disclosed herein are one or more generic chemical formulas. For thegeneral formulas provided herein, if no substituent is indicated, aperson of ordinary skill in the art will appreciate that the substituentis hydrogen. A bond that is not connected to an atom, but is shown, forexample, extending to the interior of a ring system, indicates that theposition of such substituent is variable. A curved line drawn through abond indicates that some additional structure is bonded to thatposition, typically a linker or the functional group or moiety used tocouple two moieties together (e.g., a chromophore and a tyramide ortyramide derivative). Moreover, if no stereochemistry is indicated forcompounds having one or more chiral centers, all enantiomers anddiasteromers are included. Similarly, for a recitation of aliphatic oralkyl groups, all structural isomers thereof also are included. Unlessotherwise stated, R groups (e.g., R1-R24) in the general formulasprovided below independently are selected from: hydrogen; acyl;aldehyde; alkoxy; aliphatic, particularly lower aliphatic (e.g.,C1-10alkyl, C1-10alkylene, C1-10alkyne); substituted aliphatic;heteroaliphatic (e.g., organic chains having heteroatoms, such asoxygen, nitrogen, sulfur, alkyl, particularly alkyl having 20 or fewercarbon atoms, and even more typically lower alkyl having 10 or feweratoms, such as methyl, ethyl, propyl, isopropyl, and butyl); substitutedalkyl, such as alkyl halide (e.g. —CX3 where X is a halide, andcombinations thereof, either in the chain or bonded thereto); oxime;oxime ether (e.g., methoxyimine, CH3-O—N═); alcohols (i.e. aliphatic oralkyl hydroxyl, particularly lower alkyl hydroxyl); amido; amino; aminoacid; aryl; alkyl aryl, such as benzyl; carbohydrates; monosaccharides,such as glucose and fructose; disaccharides, such as sucrose andlactose; oligosaccharides; polysaccharides; carbonyl; carboxyl;carboxylate (including salts thereof, such as Group I metal or ammoniumion carboxylates); cyclic; cyano (—CN); ester, such as alkyl ester;ether; exomethylene; halogen; heteroaryl; heterocyclic; hydroxyl;hydroxylamine; keto, such as aliphatic ketones; nitro; sulfhydryl;sulfonyl; sulfoxide; exomethylene; and combinations thereof.

“Absorbance” or “Absorption” refers to the logarithmic ratio of theradiation incident upon a material (P0), to the radiation transmittedthrough a material (P). The absorbance A of a material varies with thelight path length through it (z) according to Equation 1.

$A = {{\log\frac{P_{0}}{P}} = {{- \left( {\log\; T} \right)} = {\epsilon\;{lc}}}}$P₀ and P are the incident and transmitted light intensities, T is theoptical transmission, and ϵ is the molar extinction coefficient (M⁻¹cm⁻¹), l is the length or depth of illuminated area (cm), and c is theconcentration of the absorbing molecule.

“Amplification” refers to the act or result of making a signal stronger.

“Amplifying conjugate” refers to a molecule comprising a latent reactivespecies coupled to a hapten, such as, for example, a hapten-tyramideconjugate. The amplifying conjugate may serve as a member of a specificbinding pair, such as, for example, an anti-hapten antibody specificallybinding to the hapten. The amplification aspect relates to the latentreactive species being enzymatically converted to a reactive species sothat a single enzyme can generate a multiplicity of reactive species.Reference is made to U.S. Pat. No. 7,695,929.

“Antibody” occasionally abbreviated “Ab”, refers to immunoglobulins orimmunoglobulin-like molecules (including by way of example and withoutlimitation, IgA, IgD, IgE, IgG and IgM, combinations thereof, andsimilar molecules produced during an immune response in any vertebrate,(e.g. in mammals such as humans, goats, rabbits and mice) and antibodyfragments that specifically bind to a molecule of interest (or a groupof highly similar molecules of interest) to the substantial exclusion ofbinding to other molecules (for example, antibodies and antibodyfragments that have a binding constant for the molecule of interest thatis at least 103 M-1 greater, at least 104 M-1 greater or at least 105M-1 greater than a binding constant for other molecules in a biologicalsample. Antibody further refers to a polypeptide ligand comprising atleast a light chain or heavy chain immunoglobulin variable region whichspecifically recognizes and binds an epitope of an antigen. Antibodiesmay be composed of a heavy and a light chain, each of which has avariable region, termed the variable heavy (VH) region and the variablelight (VL) region. Together, the VH region and the VL region areresponsible for binding the antigen recognized by the antibody. The termantibody also includes intact immunoglobulins and the variants andportions of them well known in the art. Antibody fragments includeproteolytic antibody fragments [such as F(ab′)2 fragments, Fab′fragments, Fab′-SH fragments and Fab fragments as are known in the art],recombinant antibody fragments (such as sFv fragments, dsFv fragments,bispecific sFv fragments, bispecific dsFv fragments, F(ab)′2 fragments,single chain Fv proteins (“scFv”), disulfide stabilized Fv proteins(“dsFv”), diabodies, and triabodies (as are known in the art), andcamelid antibodies (see, for example, U.S. Pat. Nos. 6,015,695;6,005,079, 5,874,541; 5,840,526; 5,800,988; and 5,759,808). Antibody caninclude monoclonal antibody which are characterized by being produced bya single clone of B lymphocytes or by a cell into which the light andheavy chain genes of a single antibody have been transfected. Monoclonalantibodies are produced by methods known to those of skill in the art.Monoclonal antibodies include humanized monoclonal antibodies.

“Antigen” refers to a compound, composition, or substance that may bespecifically bound by the products of specific humoral or cellularimmunity, such as an antibody molecule or T-cell receptor. Antigens canbe any type of molecule including, for example, haptens, simpleintermediary metabolites, sugars (e.g., oligosaccharides), lipids, andhormones as well as macromolecules such as complex carbohydrates (e.g.,polysaccharides), phospholipids, nucleic acids and proteins.

“Chromophore” refers to a molecule or a part of a molecule responsiblefor its color. Color arises when a molecule absorbs certain wavelengthsof visible light and transmits or reflects others. A molecule having anenergy difference between two different molecular orbitals fallingwithin the range of the visible spectrum may absorb visible light andthus be aptly characterized as a chromophore. Visible light incident ona chromophore may be absorbed thus exciting an electron from a groundstate molecular orbital into an excited state molecular orbital.

“Conjugating,” “joining,” “bonding,” “coupling” or “linking” are usedsynonymously to mean joining a first atom or molecule to another atom ormolecule to make a larger molecule either directly or indirectly.

“Conjugate” refers to two or more molecules that are covalently linkedinto a larger construct. In some embodiments, a conjugate includes oneor more biomolecules (such as peptides, nucleic acids, proteins,enzymes, sugars, polysaccharides, lipids, glycoproteins, andlipoproteins) covalently linked to one or more other molecules, such asone or more other biomolecules. In other embodiments, a conjugateincludes one or more specific-binding molecules (such as antibodies andnucleic acid sequences) covalently linked to one or more detectablelabels (haptens, enzymes and combinations thereof). In otherembodiments, a conjugate includes one or more latent reactive moietiescovalently linked to detectable labels (haptens, chromophore moieties,fluorescent moieties).

“DABSYL” refers to 4-(dimethylamino)azobenzene-4′-sulfonamide, ayellow-orange chromophore.

“Derivative” refers to a compound that is derived from a similarcompound by replacing one atom or group of atoms with another atom orgroup of atoms.

“Epitope” refers to an antigenic determinant. These are particularchemical groups or contiguous or non-contiguous peptide sequences on amolecule that are antigenic, that is, that elicit a specific immuneresponse. An antibody binds a particular antigenic epitope.

“Enhanc(e/er/ement/ing)” An enhancer or enhancing reagent is anycompound or any combination of compounds sufficient to increase thecatalytic activity of an enzyme, as compared to the enzyme activitywithout such compound(s). Enhancer(s) or enhancing reagent(s) can alsobe defined as a compound or combination of compounds that increase oraccelerate the rate of binding an activated conjugate to a receptorsite. Enhanc(e/ement/ing) is a process by which the catalytic activityof an enzyme is increased by an enhancer, as compared to a process thatdoes not include such an enhancer. Enhanc(e/ement/ing) can also bedefined as increasing or accelerating the rate of binding of anactivated conjugate to a receptor site. Enhanc(e/ement/ing) can bemeasured visually, such as by scoring by a pathologist. In particularembodiments, scores range from greater than 0 to greater than 4, withthe higher number indicating better visual detection. More typically,scores range from greater than 0 to about 4++, such as 1, 1.5, 2, 2.5,3, 3.5, 3.75, 4, 4+, and 4++. In addition, enhanc(e/ement/ing) can bemeasured by determining the apparent Vmax of an enzyme. In particularembodiments, the term encompasses apparent Vmax values (measured asoptical density/minute) ranging from greater than 0 mOD/min to about 400mOD/min, such as about 15 mOD/min, 18 mOD/min, about 20 mOD/min, about40 mOD/min, about 60 mOD/min, about 80 mOD/min, about 100 mOD/min, about120 mOD/min, about 140 mOD/min, about 160 mOD/min, about 200 mOD/min,about 250 mOD/min, about 300 mOD/min, about 350 mOD/min, and about 400mOD/min. More typically, the Vmax ranges from greater than 0 mOD/min toabout 160 mOD/min, such as about 20 mOD/min, about 40 mOD/min, about 60mOD/min, about 80 mOD/min, about 100 mOD/min, about 120 mOD/min, about140 mOD/min, and about 160 mOD/min. In addition, enhancement can occurusing any concentration of an enhancer greater than 0 mM. Reference ismade to US Pat. Publ. No. 2012/0171668, which discloses enhancers usefulwithin the present disclosure.

“Functional group” refers to a specific group of atoms within a moleculethat is responsible for the characteristic chemical reactions of themolecule. Exemplary functional groups include, without limitation,alkane, alkene, alkyne, arene, halo (fluoro, chloro, bromo, iodo),epoxide, hydroxyl, carbonyl (ketone), aldehyde, carbonate ester,carboxylate, ether, ester, peroxy, hydroperoxy, carboxamide, amine(primary, secondary, tertiary), ammonium, imide, azide, cyanate,isocyanate, thiocyanate, nitrate, nitrite, nitrile, nitroalkane,nitroso, pyridyl, phosphate, sulfonyl, sulfide, thiol (sulfhydryl), anddisulfide.

“FWHM” refers to the full width of an absorbance peak at the halfmaximum absorbance.

“Hapten” refers to a molecule, typically a small molecule, which cancombine specifically with an antibody, but typically is substantiallyincapable of being immunogenic on its own.

“Linker” refers to a molecule or group of atoms positioned between twomoieties. For example, a signaling conjugate may include a chemicallinker between the chromophore moiety and a latent reactive moiety.Typically, linkers are bifunctional, i.e., the linker includes afunctional group at each end, wherein the functional groups are used tocouple the linker to the two moieties. The two functional groups may bethe same, i.e., a homobifunctional linker, or different, i.e., aheterobifunctional linker.

“MG” refers to Malachite green.

“Moiety” refers to a fragment of a molecule, or a portion of aconjugate.

“Molecule of interest” or “Target” each refers to a molecule for whichthe presence, location and/or concentration is to be determined.Examples of molecules of interest include proteins and nucleic acidsequences.

“Multiplex, -ed, -ing” refers to detecting multiple targets in a sampleconcurrently, substantially simultaneously, or sequentially.Multiplexing can include identifying and/or quantifying multipledistinct nucleic acids (e.g. DNA, RNA, mRNA, miRNA) and polypeptides(e.g. proteins) both individually and in any and all combinations.

“Proximal” refers to being situated at or near the reference point. Asused herein, proximal means within about 5000 nm, within about 2500 nm,within about 1000 nm, within about 500 nm, within about 250 nm, withinabout 100 nm, within about 50 nm, within about 10 nm, or within about 5nm of the reference point.

“Reactive groups” refers to a variety of groups suitable for coupling afirst unit to a second unit as described herein. For example, thereactive group might be an amine-reactive group, such as anisothiocyanate, an isocyanate, an acyl azide, an NHS ester, an acidchloride, such as sulfonyl chloride, aldehydes and glyoxals, epoxidesand oxiranes, carbonates, arylating agents, imidoesters, carbodiimides,anhydrides, and combinations thereof. Suitable thiol-reactive functionalgroups include haloacetyl and alkyl halides, maleimides, aziridines,acryloyl derivatives, arylating agents, thiol-disulfide exchangereagents, such as pyridyl disulfides, TNB-thiol, and disulfidereductants, and combinations thereof. Suitable carboxylate-reactivefunctional groups include diazoalkanes, diazoacetyl compounds,carbonyldiimidazole compounds, and carbodiimides. Suitablehydroxyl-reactive functional groups include epoxides and oxiranes,carbonyldiimidazole, N,N′-disuccinimidyl carbonates orN-hydroxysuccinimidyl chloroformates, periodate oxidizing compounds,enzymatic oxidation, alkyl halogens, and isocyanates. Aldehyde andketone-reactive functional groups include hydrazines, Schiff bases,reductive amination products, Mannich condensation products, andcombinations thereof. Active hydrogen-reactive compounds includediazonium derivatives, Mannich condensation products, iodinationreaction products, and combinations thereof. Photoreactive chemicalfunctional groups include aryl azides, halogenated aryl azides,benzophonones, diazo compounds, diazirine derivatives, and combinationsthereof.

“Rhod” refers to Rhodamine, a structural class of chromophores thatdiffer by their various substituents. In addition, the compoundtetramethylrhodamine is often referred to as “rhodamine.”

“Sample” refers to a biological specimen containing genomic DNA, RNA(including mRNA), protein, or combinations thereof, obtained from asubject. Examples include, but are not limited to, peripheral blood,urine, saliva, tissue biopsy, surgical specimen, amniocentesis samplesand autopsy material.

“Specific binding moiety” refers to a member of a specific-binding pair.Specific binding pairs are pairs of molecules that are characterized inthat they bind each other to the substantial exclusion of binding toother molecules (for example, specific binding pairs can have a bindingconstant that is at least 103 M⁻¹ greater, 104 M⁻¹ greater or 105 M⁻¹greater than a binding constant for either of the two members of thebinding pair with other molecules in a biological sample). Particularexamples of specific binding moieties include specific binding proteins(for example, antibodies, lectins, avidins such as streptavidins, andprotein A), nucleic acid sequences, and protein-nucleic acids. Specificbinding moieties can also include the molecules (or portions thereof)that are specifically bound by such specific binding proteins. Exemplaryspecific binding moieties include, but are not limited to, antibodies,nucleotides, oligonucleotides, proteins, peptides, or amino acids.

“TAMRA” refers to Carboxytetramethylrhodamine, a reddish (i.e.,variations on red to magenta) rhodamine chromophore.

“TMR” refers to Tetramethylrhodamine, a reddish rhodaminechromophore.“TSA” refers to tyramide signal amplification.

“TYR” refers to tyramine, tyramide, tyramine and/or tyramidederivatives.

II. Imaging Systems and Imaging Techniques

FIG. 1 is a front view of an imaging system 100 for imaging a specimenlocated on a specimen-bearing microscope slide 134 in accordance withone embodiment. The imaging system 100 can include a microscope 110, amulti-spectral imaging apparatus 112 (“imaging apparatus 112”), and adisplay 114. The imaging apparatus 112 can include an image capturedevice 120 and a processing device 122. The image capture device 120 ismounted on the microscope 110 and is in communication with theprocessing device 122. Oculars 128, 130 can be used to directly view abiological specimen while the display 114 displays an output 144 thatprovides increased contrast between features of interest for IHC, ISH orthe like. The features of interest can be targets (e.g., nucleic acids,antigens, etc.), labels (e.g., chromogenic labels, fluorescent labels,luminescent labels, radiometric labels, etc.), or cell components orstructures.

The microscope 110 can be used to conveniently locate a region ofinterest of the specimen. After locating the region of interest, thespecimen can be analyzed using the output 144, which can includeimage(s) and/or video, as well tissue preparation information, staininformation, patient information, reports, or the like. Video (or imagesdisplayed at a near-video rate) can minimize, limit, or substantiallyeliminate delays between direct viewing using the microscope 110 andnon-direct viewing using the display 114.

The imaging apparatus 112 can include an illuminator 140 (shown inphantom) that sequentially illuminates the specimen to separate signalsfrom stains. For example, the specimen can be illuminated with differentwavelengths, peak emissions, and/or wavebands of electromagnetic energyto separate signals from a dual stain. The image capture device 120 cancapture a set of images of the specimen. The set of images is sent tothe processing device 122 to produce the output 144.

FIG. 2(A) shows a digitally enhanced image in the form of a false-colorcomposite image 144 of a human specimen. FIG. 2(B) shows a bright fieldimage viewable through a microscope (e.g., microscope 110 of FIG. 1) ofthe same tissue. Color contrast between different color spots in theimage 144 of FIG. 2(A) is greater than the naturally-occurring colorcontrast of the same spots in FIG. 2(B). As such, a pathologist canquickly and accurately identify spots in FIG. 2(A) and may havedifficulty differentiating the spots in FIG. 2(B).

Referring to FIG. 2(A), a red spot is highlighted by a circle (R), and agreen spot is highlighted by a circle (G). Adjacent spots within circle(A) can be clearly distinguished from each other as separate red andgreen spots. Overlapping red and green spots can appear blue ashighlighted by a circle (B). A user can select the false colors of thecomposite image based on, for example, preferences, desired signalseparation, or the like. For example, the green spots can be redefinedto be blue and the red spots can be redefined to be yellow.

The red dots in FIG. 2(A) correspond to purple spots in FIG. 2(B), andthe green dots in FIG. 2(A) correspond to red spots in FIG. 2(B).Referring now to FIG. 2(B), a dual stain has been applied to the tissueand can include first chromogenic moieties and second chromogenicmoieties. A red spot corresponding to the first chromogenic moiety ishighlighted by a circle (R) and a purple feature is highlighted by acircle (P). It is difficult to distinguish between adjacent featureswithin a circle (A), and it is difficult to identify and characterizeoverlapping red and purple features as highlighted by a circle (O).Accordingly, it may difficult to rapidly and accurately detect,identify, characterize, count, or perform other tasks to score thetissue, whereas the adjacent spots within circle (A) of FIG. 2(A) can beclearly distinguished from each other, and red and green spots withincircles (R) and (G) of FIG. 2(A) can be accurately identified.

FIG. 3 is a front view of components of the imaging apparatus and themicroscope 110. The microscope 110 can include objective lenses 150 a-dand a holder device 152. The objective lenses 150 a-d are positionablealong an optical path or axis 154 extending from the illuminator 140(shown in a cutaway view) to the image capture device 120. The holderdevice 152 can include, without limitation, a stage 170, holder elements(e.g., clips) for holding a microscope slide 134 positioned upon thestage 170, and a positioning mechanism 172 for moving the stage 170. Thestage 170 can have an aperture (not shown) positioned generally alongthe optical path 154. The positioning mechanism 172 can include, withoutlimitation, one or more knobs (e.g., fine adjustment knobs, coarseadjustment knobs, X-direction knobs, Y-direction knobs, etc.), drivemechanisms, or the like. The configuration, components, and operation ofthe microscope 110 can be selected based on the tissue analysis to beperformed.

The illuminator 140 can be housed in a base 178 and is positioned on thebackside of the specimen-bearing microscope slide 134 to produce lightthat is transmitted through a specimen 156. The illustrated specimen 156is between a coverslip 139 and the slide 134. In some embodiments, theilluminator 140 can include energy emitters in the form of color lightsources 180 a, 180 b, 180 c, 180 d (collectively “light sources 180”)and a reflector 181. Each light source 180 can produce light(represented by arrows) for illuminating a portion of the specimen 156positioned within the microscope field of view. Different color lightcan be sequentially captured by the image capture device 120 without theuse of filters. In some embodiments, the illuminator 140 can be builtinto the microscope 110. In other embodiments, the illuminator 140 canbe external to the microscope 110 with light coupled into the microscope110 via an fiber optic or other type of light guide. For example, theilluminator 140 can be an external panel of LEDs connected to themicroscope 110 via a plurality of optic fibers. The illuminators canalso include drivers, switches, potentiometers, power sources, and otherelectrical devices.

For chromogenic microscopy, emitted radiation wavelength(s) orwaveband(s) from each of the light sources 180 can correspond with, orat least overlap with, absorption wavelength(s) or waveband(s)associated with chromogens. The light sources 180 can have mean or peakwavelengths in different regions of the spectrum (including infrared,visible, ultraviolet, etc.) for increased multiplexing capability. Themean wavelength, peak wavelength, emission spectrum, light intensity,color coordinate, and/or wavelength(s)/waveband(s) of the sources can beselected based on, for example, the characteristics of the stains. Insome embodiments, each source 180 can be a spectrally-discrete lightsource with a mean or peak wavelength within an absorbance waveband ofone of the chromogens.

Each source 180 can include, without limitation, one or more LEDs (e.g.,edge emitting LEDs, surface emitting LEDs, super luminescent LEDs, orthe like), laser diodes, electroluminescent light sources, incandescentlight sources, cold cathode fluorescent light sources, organic polymerlight sources, lamps, inorganic light sources, or other suitablelight-emitting sources. The sources 180 can be external or internal tothe microscope 110. The light sources 180 can be spectrally narrow lightsources having a spectral emission with a second full-width half-max(FWHM) of between about 30 nm and about 250 nm, between about 30 nm andabout 150 nm, between about 30 nm and about 100 nm, or between about 20nm and about 60 nm. Other spectral emissions can be generated.

In LED embodiments, the light source 180 a can be a blue light LEDhaving a maximum intensity at a wavelength in the blue region of thespectrum. For example, the blue light LED 180 a can have a peakwavelength and/or mean wavelength in a range of about 430 nanometers toabout 490 nanometers (nm). The light source 180 b can be a green lightLED having a maximum intensity at a wavelength in the green region ofthe spectrum. For example, the green light LED 180 b can have a peakwavelength and/or mean wavelength in a range of about 490-560 nm. Thelight source 180 c can be an amber light LED having a maximum intensityat a wavelength in the amber region of the spectrum. For example, theamber light LED 180 c can have a peak wavelength and/or mean wavelengthin a range of about 570-610 nm. The light source 180 d can be a redlight LED having a maximum intensity at a wavelength in the red regionof the spectrum. For example, the red light LED 180 d can have a peakwavelength and/or mean wavelength in a range of about 620-800 nm. Thenumber, color, and location of the LED light sources can be selectedbased on the biomarkers of the specimen.

It is often time consuming and difficult to use multiple single-labelfilters and lamps to detect all the labels in the multiplexing assay.Additionally, filters, such as long-pass filter, may cause bleedthroughand produce relatively bright image backgrounds. Multiband filters canbe used for multiplexing but often require expensive color cameras,expensive color wheels, and/or complicated software. Filters also maylead to undesirable signal-to-noise ratios. Moreover, it may bedifficult to selected appropriate dyes, illumination sources, andfilters, especially in fluorescence microscopy in which stray light hasto be minimized while maximizing transmission of the excitationemission. Advantageous, LED light sources 180 can be inexpensive and caneliminate one or more of the drawbacks associated with filters bypulsing the LEDs 180 to reliably produce a set of high quality specimenimages as discussed in connection with FIGS. 5A-D.

For mixed light, emissions from two or more of the LED light sources 180can be combined, thereby producing processing flexibility. For example,blue, green, and red LEDs 180 a-c can produce mixed light that canappear white to produce a bright field image. Different arrangements oflight sources 180 can be selected to achieve the desired illuminationfield. LED light sources 180 can be part of or form a light emittingpanel. The number, colors, and positions of the LEDs can be selected toachieve desired illumination.

In non-LED embodiments, the illuminator 140 can include, withoutlimitation, one or more lasers, halogen light sources, incandescentsources, or other devices capable of emitting light. In someembodiments, each source 180 can include a light emitter (e.g., ahalogen lamp incandescent light source, etc.) that outputs white lightand a filter that transmits certain wavelength(s) or waveband(s) of thewhite light. The source's excitation wavelength(s), peak emission, orwaveband(s) can be matched to characteristics of the stain. The lightintensity, pulse sequence (if any), and shape of illumination field fromthe light source may be determined, either empirically or modeledmathematically, to yield the desired illumination.

The image capture device 120 is positioned along the optical path 154and can capture images (e.g., low resolution digital images, highresolution digital images, multispectral images, spectrally discreteimages, etc.) of the specimen 156. The image capture device 120 caninclude, without limitation, one or more cameras (e.g., analog cameras,digital cameras, etc.), optics (e.g., one or more lenses, focus lensgroups, etc.), imaging sensors (e.g., charge-coupled devices (CCDs),complimentary metal-oxide semiconductor (CMOS) image sensors, or thelike), or the like. A plurality of lenses that cooperate to provideon-the-fly focusing and a CCD sensor can capture multispectral digitalimages, monochrome digital images, or other types of digital images. Toprovide monochrome digital images, the image capture device 120 caninclude, without limitation, one or more monochrome cameras (e.g., ablack-and-white camera, a black-and-white video camera, etc.). Toprovide color images, the image capture device 120 can be amultispectral camera. The acquired channels can be unmixed usingspectral deconvolution algorithms. Other types of image capture devicescan be used.

Referring again to FIG. 1, the processing device 122 can command theilluminator 140 and image capture device 120 such that the image capturedevice 120 is synchronized with pulsing of the light sources 180 (FIG.3). The processing device 122 can generally include, without limitation,a programmed processor 190 (“processor 190”) and a storage device 210.(Internal components are shown in phantom line.) The processing device122 can include, in addition to hardware, code that creates an executionenvironment for the computer program in question, e.g., code thatconstitutes a program, processor firmware, a protocol stack, a databasemanagement system, an operating system, a cross-platform runtimeenvironment, a virtual machine, or a combination of one or more of them.

The processor 190 can be all kinds of apparatus, device, and machine forprocessing data, including by way of example a programmablemicroprocessor, system on a chip, circuitry, or combinations of theforegoing. For example, the processor 190 can include special purposelogic circuitry 191, e.g., an FPGA (field programmable gate array) or anASIC (application-specific integrated circuit) for processing data(e.g., images, video, etc.) and can output data, such as contrastenhanced color data for generating a video of the specimen displayed ata frame rate equal to or greater than about 2 frames/second, 5frames/second, 10 frames/second, 30 frames/second, or other desiredframe rates. The processor 190 can be selected to achieve a desiredframe rate to produce a smooth video when the microscope is moved tolocate a new region of the specimen for inspection.

The storage device 210 can include executable instructions that can beexecuted by the processor 190 to, for example, convert monochromevideo/images to false color video/images, redefine colors ofvideo/images (e.g., monochrome video/images, multicolor video/images,etc.), and/or other executable instructions for altering images,classifying features (e.g., classifying spots or other features), or thelike. For example, memory of the storage device 210 can store convertinginstructions executable by the circuitry of the processor 190 to convertspecimen images into false color specimen images and to detect featuresand use a characteristic and/or morphology metric to determine whetherdetected features corresponds to genes, proteins, chromosomes, or otheranatomical structure of interest. Image characteristic metrics caninclude, for example, color, color balance, intensity, or the like. Theprocessor 190 can execute instructions from the storage device 210 toredefine colors, adjust color balance, and/or adjust intensity tofacilitate analysis based on characteristic metrics. Morphology metricscan include, for example, feature size, feature color, featureorientation, feature shape, relation or distance between features (e.g.,adjacent features), relation or distance of a feature relative toanother anatomical structure, or the like.

The storage device 210 can include a non-transitory, tangible computerreadable storage medium, such as computer-readable media that may beencoded with computer-executable instructions (e.g., a computer-readablemedium that contains the instructions). Devices suitable for storingcomputer program instructions and data include all forms of non-volatilememory, media, and memory devices, including by way of examplesemiconductor memory devices, e.g., EPROM, EEPROM, and flash memorydevices; magnetic disks, e.g., internal hard disks or removable disks;magneto-optical disks; and CD-ROM and DVD-ROM disks. A non-transitorystorage medium may include a device that is tangible, meaning that thedevice has a concrete physical form, although the device may change itsphysical state. Thus, non-transitory refers to a device remainingtangible despite a change in state. In some embodiments, the storagedevice 210 can be machine-accessible storage medium that includes, forexample, recordable/non-recordable media (e.g., ROM; RAM; magnetic diskstorage media; optical storage media; flash memory devices; etc.), etc.,or any combination thereof capable of storing data, digital images,computer program(s), or the like.

Stored digital images can be contrast enhanced color image data inbinary form. The images can also be divided into a matrix of pixels. Thepixels can include of a digital value of one or more bits, defined bythe bit depth. The digital value may represent, for example, energy,brightness, color, intensity, sound, elevation, or a classified valuederived through image processing. Non-limiting exemplary digital imageformats include, but are not limited to, bit-mapped, joint picturesexpert group (JPEG), tagged image file format (TIFF), and graphicsinterchange format (GIF), as well as other digital data formats. Videocan also be stored by the storage device 210. Stored computer programsmay, but need not, correspond to a file in a file system. A program canbe stored in a portion of a file that holds other programs or data(e.g., one or more scripts stored in a markup language document), in asingle file dedicated to the program in question, or in multiplecoordinated files (e.g., files that store one or more modules,subprograms, or portions of code). A computer program can be deployed tobe executed on one computer or on multiple computers that are located atone site or distributed across multiple sites and interconnected by acommunication network. In some laboratory setting, the storage device210 can store a computer program used by multiple computers.

Referring now to FIG. 1, a user can provide input via a selection tool200, keyboard 202, or other input device coupled to the processingdevice 122. The selection tool 200 can be used to select a portion ofthe specimen for enlarging and/or automated analysis. The user can alsoselect individual regions/cellular structures/features of interest usingthe selection tool 200.

The display 114 is communicatively coupled to the processing device 122and can be, for example, a LCD (liquid crystal display), LED(light-emitting diode) display, OLED (organic light-emitting diode)display, or other type of display for displaying information to theuser. The display 114 can be positioned next to the microscope 110 forconvenient viewing. If the microscope 110 is a digital microscope, thedigital display 114 can be part of the microscope. In other embodiments,the display 114 can be located at a remote location (e.g., anotherlaboratory). A laboratory technician can operate the microscope 110while a pathologist at the remote location studies the image 144.Multiple displays can be used to simultaneously display differentimages, including non-enhanced and enhanced images. The types ofdisplays, locations of displays, and/or number of displays can beselected based on the detection to be performed.

FIG. 4 is a flowchart of one method for producing digitally enhancedimages, video, or other output. Generally, light sources output lightcapable of being absorbed by, or causing emissions from, features ofinterest. A set of images are captured. Each image can correspond to thespecimen being exposed to light from a respective one of the lightsources. The set of images can be used to produce a digitally enhancedimage/video of the specimen. The method of FIG. 4 is discussed inconnection with FIGS. 5(A-E), but it can be used to produce other typesof enhanced images.

In block 220, a specimen carried on a microscope slide is exposed to alight source having excitation wavelength(s)/waveband(s) matched toabsorption wavelength(s)/waveband(s) of a chromogen. Incident light fromthe light source can be absorbed by the chromogen. In some embodiments,at least about 20%, 50%, 60%, 70%, 80%, or 90% of the incident light isabsorbed by the chromogen. Other percentages of light can also be absorbdepending on the stain and characteristics of the light source. Forfluorescently stained specimens, the light can cause an excitationemission from the stained features of interest. Chromogenic detectionand fluorescence detection are discussed in connection with FIGS.13(A-B).

At block 230, an image capture device (e.g., image capture device 120 ofFIGS. 1 and 3) can capture image(s)/video of the illuminated specimen.For example, a single image of the illuminated specimen can be obtained.In other embodiments, a set of images at various Z-slices or focalplanes can be captured and may have varying degrees of sharpnessthroughout the entire image and/or in specific regions.

When illumination light is absorbed by a chromogen, the light intensityis reduced at that location. FIG. 5(A) shows one captured monochromeimage of a specimen illuminated by a blue LED. A target feature in theform of a chromogen 210 can absorb blue light, thus causing thechromogen 210 to appear as a relatively dark spot. Another targetfeature in the form of a chromogen 211 can be relatively light comparedto chromogen 210. This is because the chromogen 211 absorbs less bluelight than the chromogen 210.

In decision block 234, if images have not been captured to obtaindifferent intensities for all of the features of interest, then anotherlight source can be used to illuminate an additional feature of interestat block 220 for capturing additional image(s) at block 230. Blocks 220and 230 can be repeated to produce a set of specimen images. The numberof images in a set can be equal or greater to the number of differentbiomarkers applied to a tissue sample. If a tissue sample has beentreated with six stains, a complete set of specimen images can includeat least six images. This provides flexibility for performing a widerange of different types of detection techniques. The number of imagesin a set can be increased or decreased based on the number of biomarkersin the multiplexing assay. In fluorescence analysis, a complete set ofmonochrome photomicrographs can show variances in fluorescence signals.For example, each monochrome image can have spots corresponding tofluorescence signals of a respective fluorophore.

FIGS. 5(A-D) show one complete set of monochrome photomicrographs inwhich intensities of the chromogens vary between images. In someembodiments, the set of images can include a monochrome image of thespecimen being exposed to light from a blue LED (FIG. 5(A)), amonochrome image of the specimen being exposed to light from a green LED(FIG. 5(B)), a monochrome image of the specimen being exposed to lightfrom an amber LED (FIG. 5(C)), and a monochrome image of the specimenbeing exposed to light from a red LED (FIG. 5(D)).

Below is a illumination sequence for the light sources 180 of FIG. 3that can be used to produce the images of FIGS. 5(A-E) in about 0.1second.

TIME Blue Green Amber Red (Second) LED LED LED LED Image   0-0.02 ON OFFOFF OFF FIG. 5A 0.02-0.04 OFF ON OFF OFF FIG. 5B 0.04-0.06 OFF OFF ONOFF FIG. 5C 0.06-0.8  OFF OFF OFF ON FIG. 5D 0.08-0.1  OFF OFF OFF OFFFIG. 5E

At 0-0.02 second, the blue LED 180 a (FIG. 3) illuminates the specimento produce the specimen image of FIG. 5(A). At 0.02-0.04 second, thegreen LED 180 b (FIG. 3) illuminates the specimen to produce thespecimen image of FIG. 5(B). At 0.04-0.06 second, the amber LED 180 c(FIG. 3) illuminates the specimen to produce the specimen image of FIG.5(C). At 0.06-0.08 second, the red LED 180 d (FIG. 3) illuminates thespecimen to produce the specimen image of FIG. 5(D). At 0.08-0.1 second,the processing device 122 can digitally process the set of images toproduce the image of FIG. 5E. Other time periods and sequence patternscan also be used.

In decision block 234, if a complete set of images has been generated,then the set of images is used to produce an enhanced image/video. Inblock 236, the set of images is processed to, for example, enhancecontrast, unmix spectral images, classify features, combinationsthereof, or the like. To enhance color contrast, images can bereclassified. To unmix spectral image, a classifier can identifyfeatures of interest and reclassify the image to produce a set ofprocessed images. The set of processed images can be combined to produceone or more contrast enhanced color images, spectrally deconvolvedimages, or the like. Linear mixing methods, non-linear mixing methods,or other mixing techniques known in the art, as well as digitalprocessing, can be used to produce a desired output image(s)/video.

The image/video can be displayed at block 236. In false color modes,each black-and-white monochrome image of FIGS. 5(A-D) can be convertedinto a color monochrome image (i.e., false color monochrome images). Theset of color monochrome images can be combined to produce the compositeimage of FIG. 5(D). Linear mixing methods, non-linear mixing methods, orother mixing techniques known in the art can be used to produce amultispectral image. In some embodiments, the black-and-white image ofFIG. 5(A) is converted into a red monochrome image, the black-and-whitemonochrome image of FIG. 5(C) is converted into a green monochromeimage, and the black-and-white monochrome image of FIG. 5(D) isconverted into a blue monochrome image. The color conversion can beselected based on the number of targeted features to be detected.

To produce pseudofluorescence images, the captured monochrome images canbe converted into dark-field images. The dark-field images can berecombined to produce a pseudofluorescence image. By way of example, theimages of FIGS. 5(A-C) can be converted into a red monochrome image, agreen monochrome image, and a blue monochrome image, respectively. Thefalse color images (i.e., the red, green, and blue monochrome images)can be inverted to produce dark-field images, which are combined toproduce the image of FIG. 6. The pseudofluorescence image can be rapidlygenerated and used as frames of a video.

In spectral deconvolve imaging, a classifier can be used to process theimages of FIGS. 5(A-D). Features of interest can be identified in theset of images. The classifier can detect the abundance features ofinterest and then reclassify and/or adjust the images. In someembodiments, the classifier can be trained using training slides. Eachtraining slide can carry a stained specimen. A set of images for anillumination sequence can be generated for each slide, and theillumination sequence can include sequentially illuminating the specimenwith different color light. Each set of images can be analyzed todetermine information about the stain, such as pectral information thatcan be used to detect stained features. In some embodiments, andetection algorithm, detection protocol, or other detection means cangenerated for each stain. Additional training slides can be used toproduce additional detection algorithms, detection protocols, or otherdetection means for detecting features stained with other stains. One ormore additional classifier can be generated based on the detectionalgorithms, detection protocols, or other detection means produced usingthe training sides. Alternatively, one or more classifiers can begenerated by computer modeling or other suitable technique.

Referring again to FIG. 1, the imaging system 100 can perform the methodof FIG. 4. In some embodiments, the processor device 122 canautomatically detect spots/dots/features of interest. For example, dotdetection can be performed by running the enhanced image of FIGS. 2A and5E though a number of filters. In one embodiment, the filters areDifference of Gaussian (“DOG”) filters where each filter size isselected based on the expected size of the dots/clumps of dots to bedetected. Other filters can also be used. The enhanced images can beanalyzed using analysis software. For example, color can be measured asred, blue, and green values; hue, saturation, and intensity values canbe determined. The specimens also can be evaluated qualitatively,semi-quantitatively, and/or quantitatively. Qualitative assessment caninclude assessing the staining intensity, identifying thepositively-stained cells and the intracellular compartments involved instaining, and evaluating the overall sample or slide quality. Separateevaluations can be performed on the test samples and this analysis caninclude a comparison to known average values to determine if the samplesrepresent an abnormal state. Analysis computer program can be used toidentify features and quantitatively determine a score for the slideand/or regions of interest. The computer program can be written in anyform of programming language, including compiled or interpretedlanguages, declarative or procedural languages, and it can be deployedin any form, including as a standalone program or as a module,component, subroutine, object, or other unit suitable for use in acomputing environment.

FIG. 7 is a plot of wavelength versus absorption for deposited dyes.Each of dyes has a maximal absorbance. Sulforhodamine B that has amaximal absorbance between about 560 nm and 570 nm. A specimen stainedwith Sulforhodamine B can be exposed to light having a wavelengthbetween about 560 nm and 570 nm or a waveband of about 560 nm and 570nm. The characteristics of the light sources can be selected based onthe characteristics of the dyes. For example, an illuminator can haveseventeen LEDs, each selected to match absorbance of one of the dyes.Storage devices disclosed herein can include one or more maps or lookuptables for dye characteristics. A reader (e.g., a bar code reader) canobtain information from the slide to determine appropriate wavelength(s)and/or waveband(s) for illuminating the tissue specimen. Alternatively,a user can input information about the specimen and/or dyes using, forexample, a keyboard or other input device.

III. Imaging Systems with a Scanner

FIG. 8 illustrates a computer-based system 300 and environment foranalyzing tissue specimens in accordance with an embodiment of thedisclosed technology. The system 300 includes a digital scanner in theform of a multi-spectral imaging apparatus 310 and client computersystem 320. Specimen-bearing microscope slides can be loaded into theimaging apparatus 311 that can provide narrow waveband or wavelengthimaging, bright field imaging, and/or fluorescent imaging of thespecimen-bearing microscope slides. In narrow waveband or wavelengthimaging, the imaging apparatus 311 can include an illuminator 312 and ascanner head to perform the method discussed in connection with FIGS.1-4. The imaging apparatus 311 may further be a whole-slide scanner. Oneexample whole-slide scanner can be the VENTANA iScan HT product of theassignee Ventana Medical Systems, Inc. (Tucson, Ariz.) that is modifiedwith an illuminator with multiple light sources (e.g., illuminator 140of FIG. 3). The imaging system 310 can include a slide handler mechanism318 movable to deliver one or more microscopes slides to themulti-spectral imaging apparatus and movable to remove one or moremicroscope slides from the multi-spectral imaging apparatus 311. Theslide handler mechanism 318 can include one or more robotic arms, XYZslide handlers, gripping mechanisms, transport devices, or the likecapable of transporting microscope slides between various locations. Theimages can be sent to the client computer system 320 either through adirect connection (not shown) or via a network 330. The client computersystem 320 display images to users, such as pathologists,histotechnologists, or the like.

The imaging apparatus 311 can include, without limitation, one or moreimage capture devices 313, one or more lenses 315, and facilities.(Internal components of the imaging system 310 are shown in phantomline.) Image capture device 313 can include, without limitation, adigital imager (e.g., a digital camera) with an optical system imagingsensors (e.g., a charge-coupled device (CCD), a complimentarymetal-oxide semiconductor (CMOS) image sensor, or the like), or thelike. Lenses 315 can cooperate to provide focusing (e.g.,auto-focusing). In some embodiments, the image capture device 313 hasred, green and blue color channels for producing multispectral colorimages. The optical system 315 can include multiple and/or tunablefilters, and multispectral or color image channels are created byacquiring multiple images using different filters and/or filtersettings. One method of producing a color enhanced image includesdetermining one or more scan areas comprising a region or slide positionof the microscope slide that includes at least a portion of thespecimen. The scan area may be divided into a plurality of snapshots. Animage can be produced by combining the snapshots. The combined image ofthe whole specimen or slide can have snapshots with images in the RGBchannels at the same or different focal planes.

The imaging apparatus 311 can also include an access door 321 and acontroller 323. Slides can be loaded into the imaging system 310 via theaccess door 321, and the controller 323 can be used to control operationof the imaging apparatus 311. The controller 323 can include one or moreprogrammable processors, storage devices, or the like.

The client computer system 320 can include a desktop computer, a laptopcomputer, a tablet, or the like and can include digital electroniccircuitry, firmware, hardware, memory, a computer storage medium, acomputer program, a processor (including a programmed processor), or thelike and can store digital images in binary form. The images can also bedivided into a matrix of pixels and displayed via a display 327.

A network 330 or a direct connection interconnects the imaging system310 and the client computer system 320. The network 330 may include,without limitation, one or more gateways, routers, bridges, combinationsthereof, or the like. The network 330 may include one or more serversand one or more websites that are accessible to users and can be used tosend and receive information that the client computer system 320 canutilize. A server may include, without limitation, one or moreassociated databases for storing information (e.g., digital images,algorithms, staining protocols, or the like). The network 330 caninclude, but is not limited to, data networks using the TransmissionControl Protocol (TCP), User Datagram Protocol (UDP), Internet Protocol(IP) and other data protocols. The client computer system 320 canperform the methods and techniques discussed herein. Components andfeatures of the client computer system 320 can be mixed and matched withother components and features of the disclosed technology.

IV. Techniques for Detecting a Target in a Sample

Imaging system disclosed herein can provide enhanced digital images oftissue samples stained with a wide range of stains used for IHC, ISH, orother analyses. In various embodiments, substances applied to the tissuesamples can include, without limitation, stains, wetting agents, probes,antibodies (e.g., monoclonal antibodies, polyclonal antibodies, etc.),antigen recovering fluids (e.g., aqueous- or non-aqueous-based antigenretrieval solutions, antigen recovering buffers, etc.), solvents (e.g.,alcohol, limonene, or the like), or the like. Stains include, withoutlimitation, dyes, hematoxylin stains, eosin stains, conjugates ofantibodies or nucleic acids with detectable labels such as haptens,enzymes or fluorescent moieties, or other types of substances forimparting color and/or for enhancing contrast, as well as substances canbe for antigen retrieval or other types of protocols (e.g.,immunohistochemistry protocols, in situ hybridization protocols, etc.)for preparing specimens for visual inspection, fluorescentvisualization, microscopy, or the like. Non-limiting exemplary stains,conjugates, signaling conjugates, amplifying conjugates, chromophoremoieties, chromogens, probes, counterstains, and compositions arediscussed below.

Conjugates can be used to detect one or more targets in a biologicalsample and can be used in standard assays, such as in situhybridization, immunocytochemical, and immunohistochemical detectionschemes. Any one of these assays may be combined with signalamplification, and/or the assays may concern multiplexing whereinmultiple different targets may be detected using imaging systems (e.g.,imaging systems 100, 300). One method uses an IHC detection scheme thatis combined with an ISH detection scheme. Non-limiting exemplaryembodiments of the disclosed staining and imaging techniques may be usedfor determining cell clonality (e.g., a cell expresses either one of twobiomarkers, but not both), predicting response of cancer patients tocancer therapy (e.g., detecting predictive biomarkers to determinewhether a particular patient will respond to treatment), simultaneousanalysis of biomarker expression and internal control gene expression tomonitor assay performance and sample integrity, and combinationsthereof.

Detection methods may be used on biological sample having a solid phase,such as protein components of cells or cellular structures that areimmobilized on a substrate (e.g., a microscope slide). In illustrativeembodiments, the sample is a tissue or cytology sample, such as aformalin-fixed paraffin embedded sample, mounted on a glass microscopeslide. In one embodiment, the method is particularly for an automatedslide staining instrument.

A person of ordinary skill in the art will appreciate that numeroustypes of targets may be detected and viewed using enhanced imaging. Thetarget may be a particular nucleic acid sequence, a protein, orcombinations thereof. For example, the target may be a particularsequence of RNA (e.g., mRNA, microRNA, and siRNA), DNA, and combinationsthereof. The sample may be suspected of including one or more targetmolecules of interest. Target molecules can be on the surface of cellsand the cells can be in a suspension, or in a tissue section. Targetmolecules can also be intracellular and detected upon cell lysis orpenetration of the cell by a probe. One of ordinary skill in the artwill appreciate that the method of detecting target molecules in asample will vary depending upon the type of sample and probe being used.Methods of collecting and preparing samples are known in the art.

Samples for use with the composition disclosed herein, such as a tissueor other biological sample, can be prepared using any method known inthe art by of one of ordinary skill. The samples can be obtained from asubject for routine screening or from a subject that is suspected ofhaving a disorder, such as a genetic abnormality, infection, or aneoplasia. The described embodiments of the disclosed method can also beapplied to samples that do not have genetic abnormalities, diseases,disorders, etc., referred to as “normal” samples. Such normal samplesare useful, among other things, as controls for comparison to othersamples. The samples can be analyzed for many different purposes. Forexample, the samples can be used in a scientific study or for thediagnosis of a suspected malady, or as prognostic indicators fortreatment success, survival, etc. Samples can include multiple targetsthat can be specifically bound by one or more detection probes.Throughout this disclosure when reference is made to a target protein itis understood that the nucleic acid sequences associated with thatprotein can also be used as a target. In some examples, the target is aprotein or nucleic acid molecule from a pathogen, such as a virus,bacteria, or intracellular parasite, such as from a viral genome. Forexample, a target protein may be produced from a target nucleic acidsequence associated with (e.g., correlated with, causally implicated in,etc.) a disease.

MicroRNAs (miRNAs or miRs) are small, non-coding RNAs that negativelyregulate gene expression, such as by translation repression. Forexample, miR-205 regulates epithelial to mesenchymal transition (EMT), aprocess that facilitates tissue remodeling during embryonic development.However, EMT also is an early step in tumor metastasis. Down-regulationof microRNAs, such as miR-205, may be an important step in tumorprogression. For instance, expression of miR-205 is down-regulated orlost in some breast cancers. MiR-205 also can be used to stratifysquamous cell and non-small cell lung carcinomas (J. Clin Oncol., 2009,27(12):2030-7). Other microRNAs have been found to modulate angiogenicsignaling cascades. Down-regulation of miR-126, for instance, mayexacerbate cancer progression through angiogenesis and increasedinflammation. Thus, microRNA expression levels may be indicative of adisease state. For microRNA within the scope of the present disclosure,reference is made to PCT Application No. PCT/EP2012/073984.

The disclosed imaging systems and techniques may be used to analyzeclinical breast cancer FFPE tissue blocks that have been characterizedfor HER2 gene copy number and Her2 protein expression using INFORM HER2Dual ISH DNA Probe Cocktail and IHC assays (Ventana Medical Systems,Inc., “VMSI”), respectively. HER2 mRNA expression levels relative toACTB (β-actin) can be determined using qPCR according to known methods.Results of the gene copy, protein expression, and qPCR analyses can becompared to results obtained through mRNA-ISH detection of HER2 and ACTBmRNA using the method disclosed herein to analyze FFPE samples.

The disclosed imaging systems and techniques may be used to identifymonoclonal proliferation of certain types of cells. Cancer results fromuncontrolled growth of a cell population; this population may arise froma single mutant parent cell and, therefore, comprise a clonalpopulation. An example of cancer derived from a clonal population isB-cell non-Hodgkin lymphomas (B-NHL) which arise from monoclonalproliferation of B cells. Clonal expansion of a specific B cellpopulation can be detected by sole expression of either KAPPA or LAMBDAlight chain mRNA and protein as part of their B cell receptor antibody.Accordingly, one embodiment of the method disclosed herein concernsidentifying monoclonal proliferation of B cells using chromogenic dualstaining of KAPPA and LAMBDA mRNA.

Uniform expression of either light chain by malignant B cells enablesdifferentiation of monoclonal B cell lymphomas from polyclonal KAPPA andLAMBDA light chain expressing B cell populations that result during thenormal immune response. Determining light chain mRNA expression patternsis complicated by the copy number range of light chain mRNA and antibodyprotein expressed by B cell neoplasms derived from a variety of B cellstages (naïve and memory cells: 10-100 copies per cell; plasma cells:˜100 thousand copies per cell).

Methods

A method of detecting a target in a biological sample can includecontacting the biological sample with a detection probe, contacting thebiological sample with a labeling conjugate, and contacting thebiological sample with a signaling conjugate. FIG. 9 is a flowchart fordetecting a target. In particular, the method includes a step 401 ofcontacting sample with a detection probe(s). The step can include eithera single detection probe or a plurality of detection probes specific toa plurality of different targets. A subsequent step 402 includescontacting sample with a labeling conjugate. A further subsequent step407 includes contacting sample with a signaling conjugate. Dashed linesto step 403, contacting sample with an amplifying conjugate, and step405, contacting sample with a secondary labeling conjugate representthat these steps are optional. Dashed lines to step 410 of contactingsample with an enzyme inhibitor indicates that an optional loop can beused to detect multiple targets according to a multi-plexed approach. Inparticular disclosed embodiments, one or more steps may be used whereinan enzyme inhibitor is added to the biological sample. For example, inembodiments wherein two or more signaling conjugates are added to thesample, an enzyme inhibitor (e.g., a peroxidase inhibitor) can be addedin order to inhibit or destroy any residual enzymatic activity after onesignaling conjugate has been covalently deposited and before a second,different signaling conjugate is added.

Detecting targets within the sample can include contacting thebiological sample with a first amplifying conjugate that associates withthe first labeling conjugate. For example, the amplifying conjugate maybe covalently deposited proximally to or directly on the first labelingconjugate. The first amplifying conjugate may be followed by contactingthe biological sample with a secondary labeling conjugate.Illustratively, the amplification of signal using amplifying conjugatesenhances the deposition of signaling conjugate. The enhanced depositionof signaling conjugate enables easier visual identification of thechromogenic signal, that is, the amplification makes the color darkerand easier to see. For low expressing targets, this amplification mayresult in the signal becoming sufficiently dark to be visible, whereaswithout amplification, the target would not be apparent. In embodimentswherein an amplification step is used, the biological sample may firstbe contacted with the detection probe and labeling conjugate and thensubsequently contacted with one or more amplifying conjugates. Inparticular disclosed embodiments, the amplifying conjugate comprises alatent reactive moiety coupled with a detectable label. For example, atyramine moiety (or a derivative thereof) may be coupled with a hapten,directly or indirectly, such as with a linker. The amplifying conjugatemay be covalently deposited by the enzyme of the enzyme conjugate,typically using conditions described herein or are known to a person ofordinary skill in the art that are suitable for allowing the enzyme toperform its desired function. The amplifying conjugate is thencovalently deposited on or proximal to the target.

Conditions suitable for introducing the signaling conjugates with thebiological sample are used, and typically include providing a reactionbuffer or solution that comprises a peroxide (e.g., hydrogen peroxide),and has a salt concentration and pH suitable for allowing orfacilitating the enzyme to perform its desired function. In particulardisclosed embodiments, this step of the method is performed attemperatures ranging from about 35° C. to about 40° C. These conditionsallow the enzyme and peroxide to react and promote radical formation onthe latent reactive moiety of the signaling conjugate. The latentreactive moiety, and therefore the signaling conjugate as a whole, willdeposit covalently on the biological sample, particularly at one or moretyrosine residues proximal to the immobilized enzyme conjugate, tyrosineresidues of the enzyme portion of the enzyme conjugate, and/or tyrosineresidues of the antibody portion of the enzyme conjugate. The biologicalsample is then illuminated with light and the target may be detectedthrough absorbance of the light produced by the chromogenic moiety ofthe signaling conjugate.

Depending on the level of multiplexing, the optional loop can berepeated one, two, three, four, five, six, seven, eight, or more timesdepending on the number of targets that are to be detected in thesample. During subsequent detections, the labeling conjugate can be thesame or different depending on the blocking reagents used. An example ofdifferent labeling conjugates would be a first enzyme-anti-haptenantibody conjugate and a second enzyme-anti-hapten antibody conjugate,wherein the first anti-hapten antibody and the second anti-haptenantibody are specific to different haptens. According to anotherexample, the difference could involve different anti-species antibodies,wherein the targets were detected using primary antibodies derived fromdifferent species. During subsequent detections, the signaling conjugateused for each target would typically be different. For example, thedifferent targets could be detected as different colors.

While step 401 of contacting the sample with detection probe(s) is shownin FIG. 9 to be the simultaneous detection of multiple targets duringone step, multiplexing may also be performed sequentially. A sequentialmethod would include adding a first detection probe followed by carryingout the various subsequent method steps (i.e. 402, 407, optionally 403,and 405). A second detection probe may then be added after the firstsignaling conjugate has been covalently deposited on or proximal to thefirst target, thereby providing the ability to detect a second target.This process may then be iteratively repeated using a differentsignaling conjugate comprising a chromophore moiety that differs fromthe others deposited.

The method also comprises a step 409 of illuminating sample with lightand a detecting target(s) step 411. The signal produced by the signalingconjugate is detected, thereby providing the ability to detect aparticular target. In particular disclosed embodiments, the signalproduced by the signaling conjugate may be fluorescent, chromogenic, orcombinations thereof. Exemplary embodiments concern detecting achromogenic signal. The signal may be detected using suitable methodsknown to those of ordinary skill in the art, such as chromogenicdetection methods, fluorogenic detection methods, and combinationsthereof. For example, the signal may be detected using bright fielddetection techniques or dark-field detection techniques with or withoutdigital enhancement.

FIGS. 10(A-B) are schematic diagrams of two embodiments of signalingconjugates. FIG. 10(A) illustrates a signaling conjugate 412 comprisinga latent reactive moiety 404 and a chromophore moiety 406. FIG. 10(B)illustrates an alternative signaling conjugate 414, comprisingchromophore moiety 406, latent reactive moiety 404, and furthercomprising a linker 408.

FIGS. 11(A-F) are schematic diagrams illustrating an embodiment of amethod for detecting a target 417 on a sample 416. FIG. 11(A) shows adetection probe 418, which is shown illustratively to be a nucleic acidmolecule with a hapten 419, binding to target 417, which, in this case,would be a nucleic acid target. FIG. 11(B) shows a labeling conjugate420 binding to detection probe 418. Labeling conjugate is depicted as ananti-hapten antibody specific to hapten 419 conjugate to two enzymes,depicted as the circles containing an “E”. While shown as being aconjugate of one antibody and two enzyme molecules, the number ofenzymes per antibody can be altered and optimized for particularapplications by a person of ordinary skill in the art. In particular,the number of enzymes could be modified from about 1 to about 10,depending on various factors including the size of the antibody and thesize of the enzymes. FIG. 11(C) shows signaling conjugate 412 beingenzymatically deposited onto sample 416. In particular, enzymes “E”,part of labeling conjugate 420, catalyze conversion of the first latentreactive moiety of signaling conjugate 412 into a first reactive species413. This catalysis is represented by a first large arrow 421 directingsignaling conjugate 412 to enzymes “E” and a second large arrow 422emanating from enzymes “E” to reactive species 413, which is made ofchromophore moiety 406 (FIG. 10B) and a reactive moiety, which isrepresented by the dot replacing the arrow as shown on signalingconjugate 406 (FIG. 10B). Reactive species 413 covalently binds to thebiological sample proximally to or directly on the first target, to forma covalently bound chromophore 415. FIG. 11(D) shows an alternativeembodiment in which an antibody-based detection probe 428 is used todetect a protein target 427. FIG. 11(D) is included to show thatdetection of either nucleic acid target 417 and/or protein target 427are analogous except that detection probe 428 is represented as anantibody as opposed to a nucleic acid (e.g., detection probe 418).Detection probe 428 is shown as not being haptenated, implying thatlabeling conjugate 430 is an anti-species antibody conjugated to enzymes“E”. However, in alternative embodiments, detection probe 428 could behaptenated and labeling conjugate 430 could include an anti-haptenantibody.

FIG. 11(E) shows an approach to detecting the target which uses anamplifying conjugate 442. In particular, amplifying conjugate 442 isenzymatically deposited onto a sample 436. In particular, enzymes “E”,part of labeling conjugate 440, catalyze conversion of the first latentreactive moiety of amplifying conjugate 442 into a first reactivespecies 443. This catalysis is represented by a first large arrow 431directing amplifying conjugate 442 to enzymes “E” and a second largearrow 432 emanating from enzymes “E” to reactive species 443, which ismade of a hapten (shown as a cross) and a reactive moiety, which isrepresented by the dot replacing the arrow as shown on amplifyingconjugate 442. Reactive species 443 covalently binds to the biologicalsample proximally to or directly on the first target, to form acovalently bound hapten 445. The scheme depicted in FIG. 11(E) is shownhere to make apparent the similarities between the scheme of FIG. 11(E)and the scheme of FIG. 11(C). In particular, the schemes are nearlyidentical except for the substitution of the chromophore moiety ofsignaling conjugate 412 for the hapten of amplifying conjugate 442. FIG.11(F) shows that the amplifying conjugate bound to the sample(covalently bound hapten 445 as seen in FIG. 11(E)) can be labeled witha secondary labeling conjugate 441. While not shown, the scheme shown inFIG. 11(C) can then be used for to form a covalently bound chromophore.Deposition of amplifying conjugate 442 onto the sample provides a largernumber of enzyme molecules (i.e. enzymes from labeling conjugate 440 andsecondary labeling conjugate 441 are shown proximally to the target inFIG. 11(F)).

The signaling conjugate can be detected using digital bright-fielddetection methods, automated detection methods, etc. Automated detectionmethods can include, without limitation, producing digitally enhancedimages/videos and using automated analysis techniques to detect targets.An overview of bright field detection is illustrated in FIGS. 12(A-B).FIG. 12(A) is a schematic of a cross-sectional view of sample 416including an upper surface 448 and a lower surface 449 in which aplurality of the signaling conjugates 412 are located proximally to atarget (T); the sample is shown having a first arrow 446 representingincident radiation directed towards upper surface 448 and a second arrow447 representing transmitted radiation emanating from lower surface 449.FIG. 12(B) is a graph depicting the relationship between power ofincident radiation (P₀) across sample 416 shown in FIG. 12(A) and powerof transmitted radiation (P) through the sample, the y-axis beingradiation power and the x-axis being linear distance across the sample.FIGS. 12(A-B) portray how a target could be visualized using signalingconjugate 412. Equation 1 provides the mathematical relationship betweenthe power of the incident and transmitted radiation.

The disclosed method steps may be carried out in any suitable order, andare not limited to those described herein. In particular disclosedembodiments, the method may comprise steps wherein the labelingconjugates are added to the biological sample, followed by the signalingconjugate. In other disclosed embodiments, the method may comprise stepswherein the labeling conjugates are added to the biological sample,followed by an amplifying conjugate, an additional enzyme conjugate, andthe signaling conjugate. The conjugates disclosed herein may be addedsimultaneously, or sequentially. The conjugates may be added in separatesolutions or as compositions comprising two or more conjugates. Also,each class of conjugates used in the disclosed method may comprise thesame or different conjugate components. For example, when multiplesignaling conjugates are added to the sample, the conjugates maycomprise the same or different chromogenic moieties and/or latentreactive moieties. Solely by way of example, one signaling conjugate maycomprise a coumarin chromophore coupled to a tyramine moiety and anothersignaling conjugate may comprise a rhodamine chromophore coupled to atyramine derivative moiety. The number of signaling conjugates suitablefor use in the disclosed multiplexing assay may range from one to atleast six or more typically from two to five. In particular disclosedembodiments, the method is used to detect from three to five differenttargets using from three to five different signaling conjugates.Illuminators disclosed herein can have light sources that output lightfor causing the conjugates to transmit radiation. Multiple targets maybe detected in a single assay using the systems and methods disclosedherein. In another embodiment, any one or more of the steps disclosedherein for the method are performed by an automated slide staininginstrument (e.g., imaging system 300 of FIG. 8).

Chromogenic vs. Fluorescence

Embodiments disclosed herein can be used for chromogenic andfluorescence detection. The differences between chromogenic detectionand fluorescence detection are pictorially illustrated in FIGS. 13(A)and 13(B). FIG. 13(A) shows a red chromogen example 451, a bluechromogen example 453, and a red and blue multiplexed chromogen example452. When chromogens are exposed to light (i.e., exposed to light havingan incident power of P₀), the chromogens interact with the light byabsorbing various wavelengths. For example, light can be emitted bylight sources 180 a-d or other light sources/illuminators. Thetransmitted light will have a particular power (FIG. 13(A) P₁, P₂, andP₃) depending on the absorbance of the chromogen and the amount ofchromogen present. The better detection event results in more chromogenbeing deposited, which absorbs more light and makes the observed signalsmaller. Even for colored chromogens, a reduction of the transmittedlight will eventually cause the chromogen to appear dark or black as nolight is transmitted. Multiplexing often exacerbates this effect, asshown in red and blue multiplexed chromogen example 452. When atraditional red chromogen and a blue chromogen overlap in space, theabsorbance is broad and the detection event appears blackish and dark,as illustrated by the P₃ signal being smaller than P₁ and P₂.Essentially, chromogenic detection with overlapping signals can resultin a subtractive effect. This is in contrast to fluorescence which isshown in FIG. 13(B). With reference to FIG. 13(B), a purple fluorexample 461, a green fluor example 463, and a purple and greenmultiplexed fluor example 462 are shown. The excitation light (shown asλ_(ex) in the figure) can interact with the flour 461, 462, 463 cancause an emission. The excitation light can be the same across the threeexamples and 461 exhibits λ_(f1) (purple fluorescence), 463 exhibitsλ_(f2) (green fluorescence), and 462 exhibits λ_(f1) (purplefluorescence) and λ_(f2) (green fluorescence). As more fluor isdeposited on the sample a stronger fluorescence signal is generated.Similarly, in a multiplexed scenario, there is an additive affect forthe fluorophores, whereas a subtractive effect occurs with thechromophores. This subtractive versus additive feature significantlycompounds the difficulty of multiplexing using chromogens. The imagingsystems disclosed herein can be used for chromogenic detection andfluorescence detection and can enhance color perception of the signalsby using false-color composite images. For example, the illuminator 140of FIG. 1 can be located on the front side of the slide for fluorescencedetection.

Detecting & Illuminating

The signaling conjugate is configured to provide a variety ofcharacteristics that facilitate providing a detectable signal. Thesignaling conjugate can comprise an appropriate chromophore moiety toprovide a bright field signal. If the chromophore moiety provides abright field signal, a bright field microscope can be used to visuallydetect the signal. Digital processing can also be used to facilitatedetection of the signal. For example, the chromophore disclosed hereinmay be selected to produce an optical signal suitable for visuallydetecting the target disclosed herein. In particular disclosedembodiments, the chromophore has optical properties, such as thosediscussed below, that allow the signaling conjugate to be configured toprovide the desired signal.

When light (i.e., visible electromagnetic radiation) passes through oris reflected by a colored substance, a characteristic portion of thespectral wavelength distribution is absorbed. The absorption of thischaracteristic portion imparts on the object a complementary colorcorresponding to the remaining light. FIGS. 14(A) and 14(B) show a colorwheel (FIG. 14(A)) that illustrates the relationship between an observedcolor and absorbed radiation. The color wheel includes a number of piepieces representing colors (R) Red, (O) Orange, (Y) Yellow, (G) Green,(B) Blue, (I) Indigo, and (V) Violet. Each color is shown as a separatepie piece from the next color with a series of lines terminating atnumbers outside the wheel. These numbers designate the wavelength oflight in nanometers of those wavelengths traditionally considered to bethe transition points between colors. FIG. 14(B) shows the samedistribution of colors on a linear graph having the wavelength of lighton the x-axis. That is, the region from 620 to 800 nm is shown coloredred as those wavelengths are “red” light wavelengths. Red LEDs can emitwavelengths in a range of about 620-800 nm. Typically, colors areperceived preferentially and some colors are perceived only for a verynarrow span of wavelengths. For example, a light source having emissionanywhere from 490 nm to 560 nm can be perceived as green (a 70 nm span).To be perceived as orange, the light can emit light in the range of 580nm and 620 nm (40 nm). The graph is provided for representation only,and a person of ordinary skilled in the art appreciates that theelectromagnetic spectrum is continuous in nature and not discrete asshown. However, the color classifications delineated herein facilitatean understanding of the technology as claimed herein.

When a substance absorbs a particular wavelength, the substance appearsto be the complementary color, that color corresponding to the remaininglight. The color wheel of FIG. 14(A) shows complementary colorsdiametrically opposed to each other. According to the color wheel,absorption of short wavelength bluer light (e.g., 420-430 nm light)imparts a yellow color to the substance (425 nm is opposite to thatportion of the wheel that is yellow). Similarly, absorption of light inthe range of 500-520 nm imparts a reddish to magenta color to thesubstance since the red pie area is opposite the numerical range of500-520 nm. Green is unique in that absorption of short wavelength bluerlight (e.g., near 400 nm) plus absorption of long wavelength redderlight (e.g., near 650 nm) can impart a green color to the substance.

The concept that the absorption of light at wavelengths between 420-430nm results in the substance appearing yellow is an over-simplificationof many of the absorption phenomena described herein. In particular, theabsorption spectral profile has a strong influence on the observedcolor. For example, a substance that is black absorbs stronglythroughout the range of 420-430 nm, yet the black substance does notappear yellow. In this case, the black absorber will absorb light acrossthe entire visible spectrum, including 420-430 nm. Thus, whileabsorption of light at a particular wavelength is important, absorptioncharacteristics across the visible spectra (i.e., spectral absorption)also are important.

Spectral absorption can be characterized according to several measurableparameters. The wavelength at which the maximum fraction of light isabsorbed by a substance is referred to as λ_(max). Because thiswavelength is absorbed to the greatest extent, it is typically referredto as the absorbance wavelength. An illuminator can generate with awavelength close or equal to the λ_(max) of the feature of interest tobe imaged. FIG. 15(A) is an absorption spectrum of a particularsignaling conjugate, and FIG. 15(B) illustrates a photomicrograph of aprotein stained using the signaling conjugate producing the absorptionspectrum of FIG. 15(A). FIG. 15(A) includes a first arrow (470)illustrating the magnitude of the maximum absorbance. A second arrow(471) shows the magnitude of half of the maximum. A third arrow (472)shows the width of the peak at half of the maximum absorbance. For thisexemplary signaling conjugate, λ_(max) is 552 nm and the full width ofthe peak at the half maximum absorbance (e.g. FWHM) is approximately 40nm. While λ_(max) designates the wavelength of maximum absorption, theFWHM designates the breadth of the spectral absorbance. Both factors areimportant in describing the chromophore's color because broad absorptionspectra do not appear to have a color as would be expected from theirλ_(max). Rather, they appear to be brown, black, or gray. Referring toFIG. 15(B), deposition of the signaling conjugate is clearly evident inthose locations that would be expected for positive staining (HER2 (4B5)IHC in Calu-3 xenografts). Referring back to the color wheel (FIG.14(A)), a λ_(max) of 552 nm should correspond to a complementary colorof red or red-violet. This matches the color observed in the tissuesample shown in FIG. 15(B) (note that the sample further includeshematoxylin nuclear counterstaining that is blue). Because thecounterstain is confined to the nucleus, it does not appear to interfereor substantially affect the cell-membrane based HER2 staining.

Some exemplary chromophores can have strong absorbance characteristics.In some embodiments, the chromophores are non-fluorescent or weaklyfluorescent. By virtue of its absorbance characteristics, a chromophoreis a species capable of absorbing visible light. One preferredchromophore can be capable of absorbing a sufficient quantity of visiblelight with sufficient wavelength specificity so that the chromophore canbe visualized using bright-field illumination, digital imagingtechniques, etc. In another embodiment, the chromophore has an averagemolar absorptivity of greater than about 5,000 M⁻¹ cm⁻¹ to about 250,000M⁻¹ cm⁻¹. For example, the average molar absorptivity may be greaterthan about 5,000 M⁻¹ cm⁻¹, greater than about 10,000 M⁻¹ cm⁻¹, greaterthan about 20,000 M⁻¹ cm⁻¹, greater than about 40,000 M⁻¹ cm⁻¹, orgreater than about 80,000 M⁻¹ cm⁻¹. Strong absorbance characteristicscan be used to increase the signal, or color, provided by thechromophore.

The deposition of signaling conjugates in the vicinity of the targetcreates absorption of the incident light. Because the absorption occursnon-uniformly across the sample, the location of the target, within thesample, can be identified, as discussed in connection with FIGS. 5(A-E).

Certain aspects, or all, of the disclosed embodiments can be automated,and facilitated by computer analysis and/or image analysis system. Insome applications, precise color ratios are measured by imaging systemsdisclosed herein. In some embodiments, light microscopy is utilized forimage analysis, as discussed in connection with FIG. 1. Digital imagesobtained of stained samples can be analyzed using image analysissoftware. For example, the software can be stored by the processingdevice 122. Color can be measured in several different ways. Forexample, color can be measured as red, blue, and green values; hue,saturation, and intensity values; and/or by measuring a specificwavelength or range of wavelengths using a spectral imaging camera.

Illustrative embodiments involve using bright-field imaging with thesignaling conjugates, narrow waveband imaging, and/or wavelengthimaging. In bright field illumination, white light in the visiblespectrum is transmitted through the chromophore moiety. The chromophoreabsorbs light of certain wavelengths and transmits other wavelengths.This changes the light from white to colored depending on the specificwavelengths of light transmitted.

The narrow spectral absorbance enables chromogenic multiplexing at levelbeyond the capability of traditional chromogens. For example,traditional chromogens are somewhat routinely duplexed (e.g., Fast Redand Fast Blue, Fast Red and Black (silver), Fast Red and DAB). However,triplexed or three-color applications are atypical. In illustrativeembodiments, the method includes detecting from two to about sixdifferent targets, such as three to six, or three to five, usingdifferent signaling conjugates or combinations thereof. In oneembodiment, illuminating the biological sample with light comprisesilluminating the biological sample with a spectrally narrow lightsource, the spectrally narrow light source having a spectral emissionwith a second full-width half-max (FWHM) of between about 30 nm (withfilter could be 10 nm with bright source), and about 250 nm betweenabout 30 nm and about 150 nm, between about 30 nm and about 100 nm, orbetween about 20 nm and about 60 nm. In another embodiment, illuminatingthe biological sample with light includes illuminating the biologicalsample with one or more LED light sources (e.g., LED light sources 180).In another embodiment, illuminating the biological sample with lightincludes illuminating the biological sample with a filtered lightsource. For example, the light sources 180 of FIG. 3 can include a lampand one or more filters.

The samples also can be evaluated qualitatively and semi-quantitatively.Qualitative assessment includes assessing the staining intensity,identifying the positively-staining cells and the intracellularcompartments involved in staining, and evaluating the overall sample orslide quality. Separate evaluations are performed on the test samplesand this analysis can include a comparison to known average values todetermine if the samples represent an abnormal state.

In one embodiment, the signaling conjugate is covalently depositedproximally to the target at a concentration suitable for producing adetectable signal, such as at a concentration greater than about 1×10¹¹molecules per cm²·μm to at least about 1×10¹⁶ molecules per cm²·μm ofthe biological sample. One of ordinary skill in the art could calculatethe number of molecules per cm²·μm of the biological sample by usingEquation 1 and absorbance measurements across the sample, taking care tosubtract the absorbance corresponding to the sample. In one embodimentof the disclosed method, such as a multiplexing method, detecting onesignal includes detecting an absorbance 5% or more of incident lightcompared to a background, and detecting a different, separate signalincludes detecting an absorbance of 5% or more of incident lightcompared to the background. In another embodiment, detecting one signalincludes detecting an absorbance of 20% or more of incident lightcompared to a background, and detecting a different, separate signalincludes detecting an absorbance of 20% or more of incident lightcompared to the background. In yet another embodiment, detecting onesignal includes detecting an absorbance of 30% or more of incident lightcompared to a background, and detecting a different, separate signalincludes detecting an absorbance of 30% or more of incident lightcompared to the background. An observer can view a composite image (seeFIG. 5(E)) to visually identify such absorbance. For example, coloredspots in a bright field image, digitally enhanced image, etc. cancorrespond to high absorbance regions.

In one embodiment, the first target and the second target can be geneticnucleic acids. Detecting the first target through absorbance of thelight by the first signaling conjugate includes detecting a firstcolored signal selected from red, orange, yellow, green, blue, indigo,or violet. The first colored signal is associated with spectralabsorbance associated with the first chromogenic moiety of the firstsignaling conjugate. Detecting the second target through absorbance ofthe light by the second signaling conjugate includes detecting a secondcolored signal selected from red, orange, yellow, green, blue, indigo,or violet. The second colored signal is associated with spectralabsorbance associated with the second chromogenic moiety of the secondsignaling conjugate. The colored signals can be redefined to enhancecolor contrast. An overlap in proximity through absorbance of the lightby the first signaling conjugate overlapping in proximity with thesecond signaling conjugate so that a third colored signal can bedetected that is associated with overlapping spectral absorbance of thefirst spectral absorbance and the second spectral absorbance. Accordingto one example, this third color signals a normal genetic arrangementand the first and second colors signal a genetic rearrangement ortranslocation.

ISH Three-color Break Apart Probe

Signaling conjugates can be particularly useful in multiplexed assays,as well as assays using translocation probes. FIG. 16(A) is a brightfield photomicrograph of a dual stain of two gene probes on section oflung tissue testing for ALK rearrangements associated with non-smallcell lung cancer, and FIG. 16(B) is a UV-Vis spectra of fast red andfast blue in ethyl acetate solutions. The 3′ probe was detected usingfast red and the 5′ probe was detected using fast blue. FIGS. 17(A) and17(B) illustrate the traces of FIG. 16(B) separately. FIG. 16(B) showsthat fast red and fast blue have broad and well-defined spectralabsorption characteristics. Fast red shows strong absorption betweenabout 475 nm and about 560 nm. Comparing this range to the color wheel,the expected color corresponding to the spectral absorptioncharacteristic would be either red or orange. The range of absorption isso large it essentially covers all of those wavelengths one would expectto result in a red or an orange color. Fast blue exhibits strongabsorption between about 525 nm and about 625 nm, a range even broaderthan fast red. Again, referring to the color wheel in FIG. 14(A), theabsorption from 525-625 nm covers nearly half of the color wheel withblue, indigo, and violet being complementary. To enhance contrastbetween the fast red and fast blue, a light source can emit a wavelengthwith 475 nm-560 nm for imaging the fast red and another light source canemit a wavelength within 525-625 nm for imaging the fast blue. Anenhanced image (not shown) can be produced based on absorption.

Referring now to FIG. 16(A), a fast red spot is highlighted by thecircle (R), a fast blue spot is highlighted by the circle (B), a set ofspots, one fast red spot and one fast blue spot, are labeled as adjacentby the circle (A), and a fast red spot and a fast blue spot overlappingeach other is labeled by the circle (O). As predicted, the fast red spot(A) is red, and the fast blue spot (B) appears a dark bluish color onewould expect from the mixture of blue, indigo and violet. The adjacentspots within circle (A) can be clearly distinguished from each other asseparate red and blue spots. However, the spot that includes anoverlapping red and blue spot results in an ambiguous color. It appearssomewhat bluish and has a red fringe on one side. The color of the spotis difficult to distinguish and difficult to characterize. For anoverlapping spot, the absorption of the fast red and the fast blue wouldbe additive and the spectral absorption profile would span from about475 nm to about 625 and have λ_(max) of around 550 nm. Referring againto the color wheel (FIG. 14(A)), this range of wavelengths covers nearlythe entire wheel. Broad based absorption covering the entire spectratypically gives a black or brown appearance with a tint of those colorsabsorbed least, in this case indigo and violet. A pathologistconsidering the photomicrograph in FIG. 16(A) may have difficultydistinguishing between a blue to indigo spot (B) and the overlappingspot (O).

Different signaling conjugates can be purposefully selected and made tocomprise chromogenic moieties that produce light at opposing ends of theUV-vis spectrum. FIGS. 18(A) and 18(B) illustrate how the disclosedsignaling conjugates and method can be used for resolving the issueassociated with probes comprising two different chromogenic moieties.With reference to FIG. 18(A), a chromogenic moiety capable of producinga black color (“B”) is used in combination with a chromogenic moietythat produces a red color (“R”). When the two signaling conjugatesoverlap, it is unclear as two whether the observed black color (“B”) isproduced by the black chromogenic moiety or if it is produced by theoverlap between the red and black chromogenic moieties. However,referring to FIG. 18(B), this problem can be solved by using twochromogenic moieties that, when combined, produce a third unique color.For example, a purple chromogenic moiety (“F”) may be used incombination with a yellow chromogenic moiety (“Y”). The overlap betweenthe two is readily observed, as an orange signal (“O”) is produced.FIGS. 19(A-B) further show how two colors can be deposited proximally tocreate a visually distinct third color. In particular, FIG. 19(A) showsa yellow signal, shown with a letter “y”, combined with magenta signal,shown with a letter “m”, to create a vibrant cherry red color, shownwith a letter “r”. FIG. 19(B) shows a magenta signal indicated by theletter “m” and a turquoise signal, indicated by the letter “t” combineto create a dark blue signal, shown with a letter “b”.

Illumination

A traditional white source and filter system may be used, such as thosetypically used by persons of ordinary skill in the art. For example, theilluminator 140 of FIG. 1 can include a white light source and a filterto produce set of color monochrome images. The color of the monochromeimages can be redefined and combined to produce an enhanced digitalimage. In other disclosed embodiments, an LED light source may be usedin the detection step in order to generate narrower illumination light,as discussed in connection with FIG. 3. Such light sources may be usedin embodiments wherein one or more different signaling conjugates areused, particularly when three or more different conjugates are used. LEDlight sources can provide flexibility in the range of wavelength thatcan be absorbed by the disclosed signaling conjugate. In particulardisclosed embodiments, the signaling conjugates can be visualizedindependently by illuminating the specimen with light of a wavelengthwhere the chromogen absorbs, thus causing the chromogen to appear darkagainst a light background (light is absorbed by the chromogen, reducingthe light intensity at that spot). For example, the light illuminatingthe specimen of FIG. 5(A) is absorbed by the chromogen 210, resulting inthe chromogen 210 appearing relatively dark. In particular disclosedembodiments, illuminating the specimen with light that is not absorbedby the chromogen causes the chromogen to ‘disappear’ because theintensity of the light is not altered (absorbed) as it passes throughthe chromogen spot. For example, the light illuminating the specimen ofFIG. 5(A) is not absorbed by the chromogen 211. The chromogen 211 thusappears relatively light compared to chromogen 210. The tissue featuresmay cause some transmission losses, resulting in visualization of tissuefeatures that do not absorb the light. Solely by way of example,illuminating a biological sample slide with green light causes therhodamine chromogens to appear dark, whereas the Cy5 chromogendisappears. Conversely, illuminating the slide with red light causes theCy5 chromogen to appear dark and the rhodamine chromogens to disappear.

Slides stained using certain disclosed signaling conjugates wereilluminated using a multi-LED illuminator that was adapted to OlympusBX-51 light microscope. The specimen was imaged at each eliminationstep. Two LED illuminators were used: 1) a homebuilt 3-LED illuminatorcomprising a Lamina RGB light engine (EZ-43F0-0431) with 3 LED dynamicsBuckPlus current regulated drivers with potentiometers and switches topermit on off control and variation of the red, green, and blue LEDintensities independently; and 2) a TOFRA, Inc. RGBA Computer-ControlledLED Illuminator for Upright Microscopes modified for manual LEDswitching. To visualize only the tyramide chromogens, illuminating thespecimen with light of a wavelength where the chromogen absorbs causesthe chromogen to appear dark against a light background (light isabsorbed by the chromogen, reducing the light intensity at that spot).Illuminating the specimen with light that is not absorbed by thechromogen causes the chromogen to ‘disappear’ because the intensity ofthe light is not altered (absorbed) as it passes through the chromogenspot.

FIGS. 20(A-B) are photomicrographs of a sample that has been dualstained with a turquoise and magenta signaling conjugate under (A) whitelight illumination, (B) green light illumination, and (C) red lightillumination. Illuminating the slide with red light causes the turquoisesignaling conjugates to appear dark, whereas the magenta signalingconjugate disappears. Conversely, illuminating the slide with greenlight causes the magenta signaling conjugate to appear dark and theturquoise signaling conjugate to disappear. Overlap between the magentaand the turquoise signaling conjugates are dark in white lightillumination, green light illumination, and red light illumination. Theimage of FIGS. 20(A, B) can be redefined (e.g., converted into differentcolors) and combined to promote contrast between the differentconjugates. One of the perceived benefits of fluorescence microscopy isthe ability to use filters to switch between the individual probesignals. Using the signaling conjugates described herein, it is possibleto enable switching using chromogenic compounds. LED power sources canbe easily added to a light microscope by replacing the condenser. Theemission wavelength of the LED can be switched between colors by theuser, with the push of a button 467 in FIG. 3 or automatically by theprocessing device 122. LED power sources can also replace theconventional illumination source of a brightfield microscope, withoptics to appropriately guide the light into the illumination port ofthe microscope.

Tyrosine Enhancement

Tyramide signal amplification and the signaling conjugates describedherein can react with tyrosine residues available from the sample and orthe molecules/conjugates used to detect and label the targets. Theamount of protein surrounding the biomarker to be detected is variablebased on the natural variation between tissue samples. When detectingbiomarkers present at high levels, or when detecting the co-localizationof multiple biomarkers, the amount of protein to which the tyramidemolecules can attach may be a limiting reactant in the depositionprocess. An insufficient amount of protein in the tissue can result inthe diffusion of tyramide based detection, the potential to under-callthe expression level of biomarkers, and the inability to detectco-localized biomarkers. One solution to these problems is to providemore protein binding sites (i.e. tyrosine) by coating the tissue with aproteinaceous solution and permanently cross-linking the protein to thetissue using formalin, or other fixatives.

The majority of work with TSA has been done in the context offluorescent detection. Fluorescent TSA detection is accomplished by asingle tyramide deposition of a fluorophore, and the deposition timesare typically quite short because the sensitivity of the fluorescentdetection is high, whereas the background associated with traditionalTSA becomes problematic with longer deposition times. In contrast,chromogenic TSA detection may include multiple depositions of tyramideconjugates with extended deposition times. As such, the fluorescent TSAart does not suggest solutions to chromogenic TSA problems because thenature of the problem is so different. In particular, the saturation ofa sample's tyrosine binding sites by tyramide reactive species isthought to be a unique problem particular to the detection chemistriesdescribed herein. Enhancements to TSA originating from the TSAfluorescence research typically addressed the diffusion of the reactivetyramide moieties and the lack of TSA signal. Solutions to theseproblems have been described in the art. For example, an increase in theviscosity of the reaction solution through the addition of solublepolymers was described for decreasing diffusion and HRP activity wasenhanced through the addition of vanillin and/or iodophenol. Thesesolutions were not sufficient to address some of the problems observedfor the detection chemistries described herein.

Through various studies, it was discovered that the severity of theidentified problem varies depending on the sample used. For example, itwas found that breast cancer tissues and prostate cancer tissuesincluded different levels of available tyramide binding sites. It isalso known that there are differences in protein content in the cellularcompartments (nucleus, cell membrane, cytoplasm, etc.) that are targetedin various IHC and/or ISH tests. Hence, in addition to being necessaryfor TSA co-localization, the proposed invention will normalize proteincontent (e.g. tyramide binding sites) and reduce variation between andacross samples. In illustrative embodiments, the addition of a tyrosineenhancement agent may increase inter- and intra-sample reproducibilityof assays described herein.

When using amplifying conjugates, as described herein, especially inconjunction with the signaling conjugates described herein, the amountof protein surrounding the target or targets may be insufficient. Whendetecting biomarkers present at high levels, or when detecting theco-localization of multiple biomarkers, the amount of protein in thesample to which the tyramide based detection reagents can attach may bethe limiting reagent. An insufficiency in tyramide binding sites cancause a reduced reaction rate, allow the tyramide reactive molecules todiffuse away from the target, and generally results in a weaker responsedue to lower quantities of the signaling conjugates reacting in thevicinity of the target. It was discovered that providing more bindingsites to the sample enhanced the detection as described herein. Oneapproach to enhancing the available binding sites was to introduce aprotein solution to the sample. So that the protein remains throughvarious washes and so that the protein does not diffuse during or aftersubsequent detection steps, the protein was cross-linked to the sampleusing a fixative (e.g. formalin).

In illustrative embodiments, an additional amount of atyrosine-containing reagent, such as a protein, may be incubated withand fixed to the biological sample in order to provide additionalbinding sites for multiple signaling or amplifying conjugates, such asin multiplexing or amplification. For example, when a translocationprobe is used, clearer three-color staining may be obtained by adding anadditional amount of protein to the biological sample. Additionally,non-specific probe binding can be decreased using this additional step.Exemplary embodiments concern adding BSA to the biological sample,followed by fixing the protein using a cross-linking agent, such as afixative (e.g., 10% NBF).

To demonstrate the efficacy of the solution, it was first establishedthat exogenous proteins can be fixed to a sample, (e.g. a histologicallyprepared paraffin-embedded tissue sample). To demonstrate thatadditional protein can be covalently attached to paraffin tissuesections, bovine serum albumin (BSA) was functionalized with a hapten(2,1,3-Benzoxadiaole-carbamide, “BF”). The BSA-BF was added to thetissue following a hybridization step where no probe was added, and allexperiments were completed on a Benchmark XT automated slide stainer(Ventana Medical Systems, Inc., Tucson Ariz.). 10 μg of the BSA-BFconjugate was added to the slide and incubated for 16 minutes.BF-labeled BSA protein was then covalently fixed to the tissue by adding100 μI of 4% paraformaldehyde, and incubating for 16 minutes. Thepresence of covalently attached BSA-BF was detected by adding an anti-BFmonoclonal antibody that was functionalized with the horseradishperoxidase (HRP) enzyme. FIGS. 21(A-B) show a photomicrograph (FIG.21(A)) of a control slide to which no BSA-BF was added, and FIG. 21(B)is a photomicrograph of the slide to which the BSA-BF had been used. TheHRP enzyme catalyzed the deposition of tyramide-TAMRA which stains theslide with a pink chromogen where the BSA-BF was attached to the tissue.Without the presence of the BSA-BF, under the same experimentalconditions, no pink chromogen is deposited (FIG. 21(A)), suggesting thatexogenously added BSA protein can be permanently fixed into paraffinembedded tissue sections.

It was discovered that applying a signaling conjugate, as describedherein, for certain embodiments is more efficient using a tyrosineenhancement agent following non-staining tyramide deposition cycles. Toconfirm this hypothesis, tissue samples were subjected to multiplerounds of TSA with a tyramide-hapten conjugate. FIGS. 22(A-B) arephotomicrographs of a first sample (FIG. 22(A)) to which a signalingconjugate, as described herein, was deposited and FIG. 22(B) is a secondsample in which a tyrosine enhancement solution was used prior todetection with the signaling conjugate. The difference between FIG.22(A) and FIG. 22(B) supports the hypothesis that the availability ofprotein within the sample is diminished by TSA depositions and that theaddition of the tyrosine-containing enhancers can provide more robuststaining. In the absence of protein fixation (FIG. 22(A)) the subsequentdeposition of the signaling conjugate produced a low level ofchromogenic signal. When the exogenous protein was fixed into the tissuesection using paraformaldehyde (FIG. 22(B)), the signaling conjugateproduced signals significantly more intense and numerous. The datasuggests that fixation of exogenous protein to tissue sections enhancestyramide signal amplification by providing additional protein bindingsites for the tyramide reagents to covalently attach.

One disclosed embodiment of a method for detecting a target in a samplecomprises: contacting the sample with a detection probe specific to thetarget; contacting the sample with a tyrosine enhancer; contacting thesample with a cross-linking agent; contacting the sample with atyramide-based detection reagent; and detecting the target in thesample; wherein the cross-linking reagent covalently attaches thetyrosine enhancer to the sample. In one embodiment, the method furthercomprises contacting the sample with a labeling conjugate. In anotherembodiment, the method further comprises contacting the sample with anamplifying conjugate. In one embodiment, the method further comprisesdetecting a second target, wherein contacting the sample with thetyrosine enhancer occurs subsequent to contacting the sample with thetyramide-based detection reagents for the first target and prior tocontacting the sample with tyramide-based detection reagents for thesecond target. In one embodiment, the tyrosine enhancer includes aprotein. In another embodiment, the tyrosine enhancer is a polymercontaining tyrosine residues. In one embodiment, the cross-linking agentis formalin or formaldehyde. In another embodiment, the crosslinkingagent is neutral buffered formalin (NBF). In another embodiment thecross-linking agent is an imidoester, a dimethyl suberimidate, or aN-Hydroxysuccinimide-ester (NHS ester). In another embodiment, thecross-linking agent is light radiation. In one embodiment, thecross-linking agent is UV light or X-ray radiation. In one embodiment,detecting the target in the sample includes imaging at least one of thetyramide-based detection reagents. In another embodiment, detecting thetarget includes fluorescently imaging at least one of the tyramide-baseddetection reagents. In another embodiment, detecting the target includesimaging at least one of the tyramide-based detection reagents, thetyramide-based detection reagents yielding a chromogenic signaldetectable using bright-field light microscopy. In another embodiment,detecting the target includes imaging a signaling conjugate. In anotherembodiment, detecting the target includes imaging a chromogen that wasdeposited in the vicinity of at least one of the tyramide-baseddetection reagents.

Counterstaining

Counterstaining is a method of post-treating the samples after they havealready been stained with agents to detect one or more targets, suchthat their structures can be more readily visualized. For example, acounterstain is optionally used prior to cover-slipping to render theimmunohistochemical stain more distinct. Counterstains differ in colorfrom a primary stain. Numerous counterstains are well known, such ashematoxylin, eosin, methyl green, methylene blue, Giemsa, Alcian blue,and Nuclear Fast Red. In some examples, more than one stain can be mixedtogether to produce the counterstain. This provides flexibility and theability to choose stains. For example, a first stain, can be selectedfor the mixture that has a particular attribute, but yet does not have adifferent desired attribute. A second stain can be added to the mixturethat displays the missing desired attribute. For example, toluidineblue, DAPI, and pontamine sky blue can be mixed together to form acounterstain. One aspect of the present disclosure is that thecounterstaining methods known in the art are combinable with thedisclosed methods and compositions so that the stained sample is easilyinterpretable by a reader.

V. Conjugates

Disclosed herein are various different conjugates suitable for use inthe disclosed systems and methods. The various classes of conjugatescontemplated by the present disclosure are described below. A wide ofdifferent conjugates can be used for multiplexing.

Detection Probes

Detection probes can be used to detect a target in a sample, for examplea biological sample. The detection probes can include a specific bindingmoiety that is capable of specifically binding to the target. Detectionprobes include one or more features that enable detection through alabeling conjugate. Representative detection probes include nucleic acidprobes and primary antibody probes.

In illustrative embodiments, the detection probe is an oligonucleotideprobe or an antibody probe. As described herein, detection probes may beindirect detection probes. Indirect detection probes are not configuredto be detected directly. In particular, the probes are not configuredfor the purpose of direct visualization. Instead, detection probes willgenerally be one of two types, although these are not mutually exclusivetypes. The first type of detection probe is haptenated and the secondtype of detection probes are based on a particular species of antibody.Other types of detection probes are known in the art and within thescope of the current disclosure, but these are less commonlyimplemented, for example aptamer-labeled probes or antibodies, nucleicacid tagged probes or antibodies, antibodies that are covalently boundto other antibodies so as to provide dual-binding capabilities (e.g.,through coupling techniques or through fusion proteins). While notconfigured as such, some of the detection probes may have propertiesthat enable their direct detection. For example, using haptenfluorophores is within the scope of the present disclosure. According toone embodiment, the detection probe includes a hapten label. Those ofordinary skill in the art appreciate that a detection probe can belabeled with one or more haptens using various approaches. The detectionprobe may include a hapten selected from the group consisting an oxazolehapten, pyrazole hapten, thiazole hapten, nitroaryl hapten, benzofuranhapten, triterpene hapten, urea hapten, thiourea hapten, rotenoidhapten, coumarin hapten, cyclolignan hapten, di-nitrophenyl hapten,biotin hapten, digoxigenin hapten, fluorescein hapten, and rhodaminehapten. In other examples, the detection probe is monoclonal antibodyderived from a second species such as goat, rabbit, mouse, or the like.For labeling a hapten-labeled detection probe, the labeling conjugatewould include an anti-hapten antibody. For labeling a species-baseddetection probe, the labeling conjugate may be configured with ananti-species antibody.

In illustrative embodiments, the present disclosure describes nucleicacid probes that can hybridize to one or more target nucleic acidsequences. The nucleic acid probe preferably hybridizes to a targetnucleic acid sequence under conditions suitable for hybridization, suchas conditions suitable for in situ hybridization, Southern blotting, orNorthern blotting. Preferably, the detection probe portion comprises anysuitable nucleic acid, such as RNA, DNA, LNA, PNA or combinationsthereof, and can comprise both standard nucleotides such asribonucleotides and deoxyribonucleotides, as well as nucleotide analogs.LNA and PNA are two examples of nucleic acid analogs that formhybridization complexes that are more stable (i.e., have an increasedTm) than those formed between DNA and DNA or DNA and RNA. LNA and PNAanalogs can be combined with traditional DNA and RNA nucleosides duringchemical synthesis to provide hybrid nucleic acid molecules than can beused as probes. Use of the LNA and PNA analogs allows modification ofhybridization parameters such as the Tm of the hybridization complex.This allows the design of detection probes that hybridize to thedetection target sequences of the target nucleic acid probes underconditions that are the same or similar to the conditions required forhybridization of the target probe portion to the target nucleic acidsequence.

Suitable nucleic acid probes can be selected manually, or with theassistance of a computer implemented algorithm that optimizes probeselection based on desired parameters, such as temperature, length, GCcontent, etc. Numerous computer implemented algorithms or programs foruse via the internet or on a personal computer are available. Forexample, to generate multiple binding regions from a target nucleic acidsequence (e.g., genomic target nucleic acid sequence), regions ofsequence devoid of repetitive (or other undesirable, e.g.,background-producing) nucleic acid sequence are identified, for examplemanually or by using a computer algorithm, such as RepeatMasker. Methodsof creating repeat depleted and uniquely specific probes are found in,for example, US Patent Publication No. 2012/0070862. Within a targetnucleic acid sequence (e.g., genomic target nucleic acid sequence) thatspans several to several-hundred kilobases, typically numerous bindingregions that are substantially or preferably completely free ofrepetitive (or other undesirable, e.g., background-producing) nucleicacid sequences are identified.

In some embodiments, a hapten is incorporated into the nucleic acidprobe, for example, by use of a haptenylated nucleoside. Methods forconjugating haptens and other labels to dNTPs (e.g., to facilitateincorporation into labeled probes) are well known in the art. Indeed,numerous labeled dNTPs are available commercially, for example fromInvitrogen Detection Technologies (Molecular Probes, Eugene, Oreg.). Alabel can be directly or indirectly attached to a dNTP at any locationon the dNTP, such as a phosphate (e.g., α, β or γ phosphate), a ring orexocyclic position, or a sugar. The probes can be synthesized by anysuitable, known nucleic acid synthesis method. In some embodiments, thedetection probes are chemically synthesized using phosphoramiditenucleosides and/or phosphoramidite nucleoside analogs. For example, insome embodiments, the probes are synthesized by using standard RNA orDNA phosphoramidite nucleosides. In some embodiments, the probes aresynthesized using either LNA phosphoramidites or PNA phosphoramidites,alone or in combination with standard phosphoramidite nucleosides. Insome embodiments, haptens are introduced on abasic phosphoramiditescontaining the desired detectable moieties. Other methods can also beused for detection probe synthesis. For example, a primer made from LNAanalogs or a combination of LNA analogs and standard nucleotides can beused for transcription of the remainder of the probe. As anotherexample, a primer comprising detectable moieties is utilized fortranscription of the rest of the probe. In still other embodiments,segments of the probe produced, for example, by transcription orchemical synthesis, may be joined by enzymatic or chemical ligation.

A variety of haptens may be used in the detectable moiety portion of thedetection probe. Such haptens include, but are not limited to,pyrazoles, particularly nitropyrazoles; nitrophenyl compounds;benzofurazans; triterpenes; ureas and thioureas, particularly phenylureas, and even more particularly phenyl thioureas; rotenone androtenone derivatives, also referred to herein as rotenoids; oxazole andthiazoles, particularly oxazole and thiazole sulfonamides; coumarin andcoumarin derivatives; cyclolignans, exemplified by podophyllotoxin andpodophyllotoxin derivatives; and combinations thereof. Fluoresceinderivatives (FITC, TAMRA, Texas Red, etc.), Digoxygenin (DIG),5-Nitro-3-pyrozolecarbamide (nitropyrazole, NP),4,5,-Dimethoxy-2-nitrocinnamide (nitrocinnamide, NCA),2-(3,4-Dimethoxyphenyl)-quinoline-4-carbamide (phenylquinolone, DPQ),2,1,3-Benzoxadiazole-5-carbamide (benzofurazan, BF),3-Hydroxy-2-quinoxalinecarbamide (hydroxy quinoxaline, HQ),4-(Dimethylamino)azobenzene-4′-sulfonamide (DABSYL), Rotenoneisoxazoline (Rot),(E)-2-(2-(2-oxo-2,3-dihydro-1H-benzo[b][1,4]diazepin-4-yl)phenozy)acetamide(benzodiazepine, BD), 7-(diethylamino)-2-oxo-2H-chromene-3-carboxylicacid (coumarin 343, CDO), 2-Acetamido-4-methyl-5-thiazolesulfonamide(thiazolesulfonamide, TS), and p-Mehtoxyphenylpyrazopodophyllamide(Podo). These haptens and their use in probes are described in moredetail in U.S. Pat. No. 7,695,929.

Labeling Conjugates & Secondary Labeling Conjugates

In illustrative embodiments, the labeling conjugate specifically bindsto the detection probe and is configured to label the target with anenzyme. As described above, detection probes configured from a secondspecies or to include a hapten can be detected by either an anti-speciesantibody or an anti-hapten antibody. One approach to configuring alabeling conjugate has been to directly couple an enzyme to theanti-species or anti-hapten antibody. Conjugates of this kind, which mayor may not include various linkers, are also described in U.S. Pat. No.7,695,929. The labeling conjugate includes one or more enzymes.Exemplary enzymes include oxidoreductases or peroxidases. The signalingconjugate includes a latent reactive moiety and a chromogenic moiety.The enzyme catalyzes conversion of the latent reactive moiety into areactive moiety which covalently binds to the biological sampleproximally to or directly on the target.

The secondary labeling conjugate is used in connection with theamplifying conjugates, as described herein. Secondary labelingconjugates are configured in the same manner as labeling conjugatesexcept that they are configured to label haptens deposited through anamplification process instead of haptens conjugated to detectionconjugates. In illustrative embodiments, a secondary labeling conjugatecomprises an anti-hapten antibody conjugated to an enzyme. In oneembodiment, the enzyme is an oxidoreductase or a peroxidase.

Signaling Conjugate

Another type of conjugate disclosed herein is a signaling conjugate. Thesignaling conjugate provides the detectable signal that is used todetect the target, according to the methods disclosed herein. Inparticular disclosed embodiments, the signaling conjugate comprises alatent reactive moiety and a chromophore moiety.

Signaling conjugates may be configured to absorb light more selectivelythan traditionally available chromogens. Detection is realized byabsorbance of the light by the signaling conjugate; for example,absorbance of at least about 5% of incident light would facilitatedetection of the target. In other darker stains, at least about 20% ofincident light would be absorbed. Non-uniform absorbance of light withinthe visible spectra results in the chromophore moiety appearing colored.The chromogen conjugates disclosed herein may appear colored due totheir absorbance; the chromogen conjugates may appear red, orange,yellow, green, indigo, or violet depending on the spectral absorbanceassociated with the chomophore moiety. According to another aspect, thechromophore moieties may have narrower spectral absorbances than thoseabsorbances of traditionally used chromogens (e.g., DAB, Fast Red, FastBlue). In illustrative embodiments, the spectral absorbance associatedwith the first chromophore moiety of the first signaling conjugate has afull-width half-max (FWHM) of between about 30 nm and about 250 nm,between about 30 nm and about 150 nm, between about 30 nm and about 100nm, or between about 20 nm and about 60 nm.

Narrow spectral absorbances enable the signaling conjugate chromophoremoiety to be analyzed differently than traditional chromogens. Whilehaving enhanced features compared to traditionally chromogens, detectingthe signaling conjugates remains simple. Detecting can include using abright-field microscope, imaging systems disclosed herein, or anequivalent digital scanner.

An embodiment of the disclosed signaling conjugate is illustrated inFIGS. 10(A) and 10(B). Referring to FIGS. 10(A-B), the signalingconjugate 412 comprises a latent reactive moiety 404 and a chromophoremoiety 6; in another embodiment, an alternative signaling conjugate 414may include a linker 408 for conjugating chromophore moiety 406 tolatent reactive moiety 404. In particular disclosed embodiments, thesignaling conjugate has the following general Formula 1:

The disclosed signaling conjugate typically comprises a latent reactivemoiety as described herein. For example, the latent reactive moiety maybe the same or different from that of the disclosed amplificationconjugate; however, each latent reactive moiety is capable of forming areactive radical species and has the general formula provided herein. Asshown in Formula 1, the signaling conjugate may comprise an optionallinker. If a linker is used, it may be selected from any of the linkersdisclosed herein. In particular disclosed embodiments, the linker isselected to improve hydrophilic solution solubility of the signalingconjugate, and/or to improve conjugate functionality on the biologicalsample. In particular disclosed embodiment, the linker is an alkyleneoxide linker, such as a polyethylene glycol linker; however, any of thelinkers disclosed herein may be used for the signaling conjugate.

Chromophore Moiety

A chromophore moiety is generally described as the part of a moleculeresponsible for its color. Colors arise when a molecule absorbs certainwavelengths of visible light and transmits or reflects others. Thechromophore is a region in the molecule where the energy differencebetween two different molecular orbitals falls within the range of thevisible spectrum, wherein visible light interacting with that region canbe absorbed. The absorbance is usually associated with an electrontransition from its ground state to an excited state. Molecules havingground state to excited state energy differences within the visiblespectrum are often conjugated carbon structures. In these compounds,electrons transition between energy levels that are extendedpi-orbitals, created by a series of alternating single and double bonds,often in aromatic systems. Common examples include various foodcolorings, fabric dyes (azo compounds), pH indicators, lycopene,p-carotene, and anthocyanins. The structure of the molecule imparts thecharacteristic of the pi-orbitals which result in the energy level.Typically, lengthening or extending a conjugated system with moreunsaturated (multiple) bonds in a molecule will tend to shift absorptionto longer wavelengths. Woodward-Fieser rules can be used to approximateultraviolet-visible maximum absorption wavelength in organic compoundswith conjugated pi-bond systems.

In illustrative embodiments, metal complexes can be chromophores. Forexample, a metal in a coordination complex with ligands will oftenabsorb visible light. For example, chlorophyll and hemoglobin (theoxygen transporter in the blood of vertebrate animals) are chromophoresthat include metal complexes. In these two examples, a metal iscomplexed at the center of a porphyrin ring: the metal being iron in theheme group of hemoglobin, or magnesium in the case of chlorophyll. Thehighly conjugated pi-bonding system of the porphyrin ring absorbsvisible light. The nature of the central metal can also influence theabsorption spectrum of the metalloporphyrin complex or properties suchas excited state lifetime.

In illustrative embodiments, the chromophore moiety is a coumarin orcoumarin derivative. A general formula for coumarin and coumarinderivatives is provided below.

With reference to Formula 2, R¹-R⁶ are defined herein. At least one ofthe R¹-R⁶ substituents also typically is bonded to a linker or thelatent reactive moiety (e.g., a tyramide or tyramide derivative).Certain working embodiments have used the position indicated as havingan R⁵ substituent for coupling to a linker or latent reactive moiety(e.g., a tyramide or tyramide derivative). Substituents other thanhydrogen at the 4 position are believed to quench fluorescence, but areuseful within the scope of the present disclosure. Y is selected fromoxygen, nitrogen or sulfur. Two or more of the R¹—R⁶ substituentsavailable for forming such compounds also may be atoms, typically carbonatoms, in a ring system bonded or fused to the compounds having theillustrated general formula. Exemplary embodiments of these types ofcompounds include:

A person of ordinary skill in the art will appreciate that the ringsalso could be heterocyclic and/or heteroaryl.

Working embodiments typically comprise fused A-D ring systems having atleast one linker, tyramide, or tyramide derivative coupling position,with one possible coupling position being indicated below:

With reference to Formula 3, the R and Y variable groups are as statedherein. Most typically, R¹—R¹⁴ independently are hydrogen or loweralkyl. Particular embodiments of coumarin-based chromophores include2,3,6,7-tetrahydro-11-oxo-1H,5H,11H-[1]benzopyrano[6,7,8-ij]quinolizine-10-carboxylicacid

and 7-(diethylamino)coumarin-3-carboxylic acid

Another class of chromogenic moieties suitable for use herein includediazo-containing chromogens. These particular chromophores may have aformula as illustrated below.

With respect to this formula, ring E may be selected from phenyl,imidazole, pyrazole, oxazole, and the like. Each R² independently may beselected from those groups recited herein. In particular disclosedembodiments, each R² independently is selected from amine, substitutedamine, phenyl, hydroxyl, sulfonyl chloride, sulfonate, carboxylate, andcombinations thereof; and n may range from zero to 5. Particulardisclosed embodiments may be selected from the following diazochromophores: DABSYL, which has a λ_(max) of about 436 nm and has thefollowing chemical structure

andTartrazine, which has a λ_(max) of about 427 nm and has the followingchemical structure

In yet other embodiments, the chromophore may be a triarylmethanecompound. Triarylmethane compounds within the scope of the presentdisclosure may have the following formula.

With respect to Formula 4, each R^(a) independently may be selected fromhydrogen, aliphatic, aryl, and alkyl aryl; and each R²⁴ may be selectedfrom amine, substituted amine, hydroxyl, alkoxy, and combinationsthereof; each n independently may range from zero to 5. Exemplarychromophores are provided below:

In other disclosed embodiments, the chromophore moiety may have thefollowing formula

wherein each R^(a) independently may be selected from hydrogen,aliphatic, aryl, and alkyl aryl; each R²⁴ independently may be selectedfrom the groups provided herein, including substituted aryl, whichcomprises an aryl group substituted with one or more groups selectedfrom any one of R¹-R²³, which are disclosed herein; Y may be nitrogen orcarbon; Z may be nitrogen or oxygen; and n may range from zero to 4. Inparticular disclosed embodiments, Z is nitrogen and each R^(a) may bealiphatic and fused with a carbon atom of the ring to which the aminecomprising R^(a) is attached, or each Ra may join together to form a 4or 6-membered aliphatic or aromatic ring, which may be furthersubstituted. Exemplary embodiments are provided as follows:

andother rhodamine derivatives, such as tetramethylrhodamines (includingTMR, TAMRA, and reactive isothiocyanate derivatives), anddiarylrhodamine derivatives, such as the QSY 7, QSY 9, and QSY 21 dyes.

Exemplary chromophores are selected from the group consisting of DAB;AEC; CN; BCIP/NBT; fast red; fast blue; fuchsin; NBT; ALK GOLD; CascadeBlue acetyl azide; Dapoxylsulfonic acid/carboxylic acid succinimidylester; DY-405; Alexa Fluor 405 succinimidyl ester; Cascade Yellowsuccinimidyl ester; pyridyloxazole succinimidyl ester (PyMPO); PacificBlue succinimidyl ester; DY-415; 7-hydroxycoumarin-3-carboxylic acidsuccinimidyl ester; DYQ-425; 6-FAM phosphoramidite; Lucifer Yellow;iodoacetamide; Alexa Fluor 430 succinimidyl ester; Dabcyl succinimidylester; NBD chloride/fluoride; QSY 35 succinimidyl ester; DY-485XL; Cy2succinimidyl ester; DY-490; Oregon Green 488 carboxylic acidsuccinimidyl ester; Alexa Fluor 488 succinimidyl ester; BODIPY 493/503C3 succinimidyl ester; DY-480XL; BODIPY FL C3 succinimidyl ester; BODIPYFL C5 succinimidyl ester; BODIPY FL-X succinimidyl ester; DYQ-505;Oregon Green 514 carboxylic acid succinimidyl ester; DY-510XL; DY-481XL;6-carboxy-4′, 5′-dichloro-2′, 7′-dimethoxyfluorescein succinimidyl ester(JOE); DY-520XL; DY-521XL; BODIPY R6G C3 succinimidyl ester; erythrosinisothiocyanate; 5-carboxy-2′,4′,5′,7′-tetrabromosulfonefluoresceinsuccinimidyl ester; Alexa Fluor 532 succinimidyl ester; 6-carboxy-2′,4,4′, 5′7,7′-hexachlorofluorescein succinimidyl ester (HEX); BODIPY530/550 C3 succinimidyl ester; DY-530; BODIPY TMR-X succinimidyl ester;DY-555; DYQ-1; DY-556; Cy3 succinimidyl ester; DY-547; DY-549; DY-550;Alexa Fluor 555 succinimidyl ester; Alexa Fluor 546 succinimidyl ester;DY-548; BODIPY 558/568 C3 succinimidyl ester; Rhodamine red-Xsuccinimidyl ester; QSY 7 succinimidyl ester; BODIPY 564/570 C3succinimidyl ester; BODIPY 576/589 C3 succinimidyl ester;carboxy-X-rhodamine (ROX); succinimidyl ester; Alexa Fluor 568succinimidyl ester; DY-590; BODIPY 581/591 C3 succinimidyl ester;DY-591; BODIPY TR-X succinimidyl ester; Alexa Fluor 594 succinimidylester; DY-594; carboxynaphthofluorescein succinimidyl ester; DY-605;DY-610; Alexa Fluor 610 succinimidyl ester; DY-615; BODIPY 630/650-Xsuccinimidyl ester; erioglaucine; Alexa Fluor 633 succinimidyl ester;Alexa Fluor 635 succinimidyl ester; DY-634; DY-630; DY-631; DY-632;DY-633; DYQ-2; DY-636; BODIPY 650/665-X succinimidyl ester; DY-635; Cy5succinimidyl ester; Alexa Fluor 647 succinimidyl ester; DY-647; DY-648;DY-650; DY-654; DY-652; DY-649; DY-651; DYQ-660; DYQ-661; Alexa Fluor660 succinimidyl ester; Cy5.5 succinimidyl ester; DY-677; DY-675;DY-676; DY-678; Alexa Fluor 680 succinimidyl ester; DY-679; DY-680;DY-682; DY-681; DYQ-3; DYQ-700; Alexa Fluor 700 succinimidyl ester;DY-703; DY-701; DY-704; DY-700; DY-730; DY-731; DY-732; DY-734; DY-750;Cy7 succinimidyl ester; DY-749; DYQ-4; and Cy7.5 succinimidyl ester.

In particular disclosed embodiments, the chromophore moiety may beselected from tartrazine, 7-diethylaminocoumarin-3-carboxylic acid,succinimidyl ester, Dabsyl sulfonyl chloride, fluorescein isothiocyanate(FITC) carboxy succinimidyl ester (DY-495), Rhodamine Green carboxylicacid succinimidyl ester (DY-505), eosin isothiocyanate (EITC),6-carboxy-2′,4,7,7′-tetrachlorofluorescein succinimidyl ester (TET),carboxyrhodamine 6G succinimidyl ester, carboxytetramethylrhodaminesuccinimidyl ester (TMR, TAMRA) (DY-554), QSY 9 succinimidyl ester,sulforhodamine B sulfonyl chloride (DY-560), Texas Red (sulforhodamine101), gallocyanine, Fast Green FCF, Malachite Green, isothiocyanate, andQSY 21 succinimidyl ester. In certain disclosed embodiments, thechromophore moiety of the signaling conjugate is Dabsyl sulfonylchloride, FITC, 7-diethylaminocoumarin-3-carboxylic acid, succinimidylester, Rhodamine Green carboxylic acid succinimidyl ester (DY-505),eosin isothiocyanate (EITC), 6-carboxy-2′, 4,7,7′-tetrachlorofluoresceinsuccinimidyl ester (TET), carboxytetramethylrhodamine succinimidyl ester(TMR, TAMRA) (DY-554), sulforhodamine B sulfonyl chloride (DY-560),Texas Red (sulforhodamine 101), and gallocyanine.

Further exemplary chromogenic moieties that are used for the signalingconjugate are provided below:

The signaling conjugate can have absorption maxima and absorptionbreadths particularly suited for bright-field imaging of targets inbiological samples. In one embodiment, a signaling conjugate isconfigured to provide an absorbance peak having a λ_(max) of betweenabout 350 nm and about 800 nm, between about 400 nm and about 750 nm, orbetween about 400 nm and about 700 nm. These wavelength ranges are ofparticular interest because they translate into colors visible tohumans. However, the approaches described herein could also be appliedto chromophore moieties useful for near infrared (NIR), infrared (IR),or ultraviolet (UV) diagnostic methodologies. The signaling conjugatesnon-visible peaks can be imaged and converted into colors. In someembodiments, the illuminator 140 of FIGS. 1 and 3 can include one ormore IR and/or UV sources. Referring to FIG. 3, for example, the lightsources 180 can be IR and/or UV sources that emit IR/UV energy towardsthe specimen. The image capture device 120 can be configured to capturean image of the specimen based on the IR/UV energy from the specimen.The captured image can be converted into a viewable color image (e.g., afalse color monochrome image). If multiple viewable color images arecaptured for multiplexing, the set of images can be combined to producea composite image (e.g., a digitally enhanced image).

In one embodiment the signaling conjugate is configured to produce acolored signal selected from the group consisting of red, orange,yellow, green, indigo, violet, or mixtures thereof. In one embodiment, asignaling conjugate has a λ_(max) of between about 400 nm and 430 nm. Inanother embodiment, the signaling conjugate produces a yellow signal. Inone embodiment, a signaling conjugate has a λ_(max) of between about 430nm and 490 nm. In another embodiment, the signaling conjugate producesan orange signal. In one embodiment, a signaling conjugate has a λ_(max)of between about 490 nm and 560 nm. In another embodiment, the signalingconjugate produces a red signal. In one embodiment, a signalingconjugate has a λ_(max) of between about 560 nm and 570 nm. In anotherembodiment, the signaling conjugate produces a violet signal. In oneembodiment, a signaling conjugate has a λ_(max) of between about 570 nmand 580 nm. In another embodiment, the signaling conjugate produces anindigo signal. In one embodiment, a signaling conjugate has a λ_(max) ofbetween about 580 nm and 620 nm. In another embodiment, the signalingconjugate produces a blue signal. In one embodiment, a signalingconjugate has a λ_(max) of between about 620 nm and about 800 nm. Inanother embodiment, the signaling conjugate produces a green toblue-green signal.

In one embodiment, the signaling conjugate is configured to have afull-width half-max (FWHM) of between about 20 nm and about 60 nm,between about 30 and about 100 nm, between about 30 and about 150 nm, orbetween about 30 and about 250 nm. In particular disclosed embodiments,the FWHM is less than about 300 nm, less than about 250 nm, less thanabout 200 nm, less than about 150 nm, less than about 100 nm, less thanabout 50 nm. In illustrative embodiments, a signaling conjugate having aFWHM of less than about 150 nm is described. In one embodiment, the FWHMis less than about 150 nm, less than about 120 nm, less than about 100nm, less than about 80 nm, less than about 60 nm, less than about 50 nm,less than about 40 nm, less than about 30 nm, between about 10 nm and150 nm, between about 10 nm and 120 nm, between about 10 nm and 100 nm,between about 10 nm and 80 nm, between about 10 nm and 60 nm, betweenabout 10 nm and 50 nm, or between about 10 nm and 40 nm.

In another embodiment, the signaling conjugate has an average molarabsorptivity of greater than about 5,000 M-1 cm-1 to about 250,000 M-1cm-1. Cy dyes can have extinction coefficients >200,000 M-1 cm-1. Forexample, an average molar absorptivity of greater than about 5,000 M-1cm-1, greater than about 10,000 M-1 cm-1, greater than about 20,000 M-1cm-1, greater than about 40,000 M-1 cm-1, or greater than about 80,000M-1 cm-1. In yet another embodiment, the signaling conjugate has asolubility in water of at least about 0.1 mM to about 1 M. For example,the signaling conjugate has a solubility in water of at least about 0.1mM, at least about 1 mM, at least about 10 mM, at least about 100 mM, orat least about 1 M. In one embodiment, the signaling conjugate is stableagainst precipitation in an aqueous buffered solution for greater thanabout 1 month to about 30 months. For example, the signaling conjugateis stable against precipitation in an aqueous buffered solution forgreater than about 1 month, greater than about 3 months, greater thanabout 6 months, greater than about 12 months, greater than about 18months, or greater than about 24 months.

FIG. 23(A) is a first photomicrograph and FIG. 23(B) is a secondphotomicrograph of a protein stained (HER2 (4B5) IHC in Calu-3xenografts) using the signaling conjugate having the absorption spectrashown in FIG. 24. Trace A corresponds to the signaling conjugate usedfor FIG. 23(A) and trace B corresponds to the signaling conjugated usedfor FIG. 23 (B); note that each signaling conjugate was analyzed withspectrometry in solution prior to staining and on the slide subsequentto having detected the HER2 (the dashed traces representing the spectraobtained on the tissue). The signaling conjugate used to stain thetissue shown in FIG. 23(A) has a λ_(max) of about 456 nm and a FWHM ofabout 111 nm. The signaling conjugate used to stain the tissue shown inFIG. 23(B) has a λ_(max) of about 628 nm and a FWHM of about 70 nm.

Latent Reactive Moiety

The latent reactive moiety is configured to undergo catalytic activationto form a reactive species that can covalently bond with the sample orto other detection components. The catalytic activation is driven by oneor more enzymes (e.g., oxidoreductase enzymes and peroxidase enzymes,like horseradish peroxidase). In the presence of peroxide, these enzymescan catalyze the formation of reactive species. These reactive species,e.g. free radicals, are capable of reacting with phenolic compoundsproximal to their generation, i.e. near the enzyme. The phenoliccompounds available in the sample are often tyrosyl residues withinproteins. As such, the latent reactive moiety can be added to aprotein-containing sample in the presence of a peroxidase enzyme and aperoxide (e.g., hydrogen peroxide), which can catalyze radical formationand subsequently cause the reactive moiety to form a covalent bond withthe biological sample.

In particular disclosed embodiments, the latent reactive moietycomprises at least one aromatic moiety. In exemplary embodiments, thelatent reactive moiety comprises a phenolic moiety and binds to a phenolgroup of a tyrosine amino acid. It is desirable, however, tospecifically bind the labeling conjugate via the latent reactive moietyat, or in close proximity to, a desired target with the sample. Thisobjective can be achieved by immobilizing the enzyme on the targetregion, as described herein. Only latent reactive moieties in closeproximity to the immobilized enzyme will react and form bonds withtyrosine residues in the vicinity of, or proximal to, the immobilizedenzyme, including tyrosine residues in the enzyme itself, tyrosineresidues in the antibody to which the enzyme is conjugated, and/ortyrosine residues in the sample that are proximal to the immobilizedenzyme. In particular disclosed embodiments, the labeling conjugate canbe bound proximally, such as within about 800 nm, within about 100 nm,within about 10 nm, or within about 5 nm of the immobilized enzyme. Forexample, the tyrosine residue may be within a distance of about 10angstroms to about 800 nm, about 100 angstroms to about 50 nm, about 10angstroms to about 10 nm, or about 10 angstroms to about 5 nm from theimmobilized enzyme. Such proximal binding allows the target to bedetected with at least the same degree of specificity as conventionalstaining methods used with the detection methods disclosed herein. Forexample, embodiments of the disclosed method allow sub cellularstructures to be distinguished, e.g., nuclear membrane versus thenuclear region, cellular membrane versus the cytoplasmic region, etc.

Latent reactive moiety can be the general formula illustrated below.

With reference to Formula 5, R²⁵ is selected from the group consistingof hydroxyl, ether, amine, and substituted amine; R²⁶ is selected fromthe group consisting of alkyl, alkenyl, alkynyl, aryl, heteroaryl,—OR_(m), —NR_(m), and —SR_(m), where m is 1-20; n is 1-20; Z is selectedfrom the group consisting of oxygen, sulfur, and NR^(a) where R^(a) isselected from the group consisting of hydrogen, aliphatic, aryl, andalkyl aryl. An exemplary embodiment of the latent reactive moiety istyramine (or tyramide, which is the name given to a tyramine moleculeconjugated with the detectable label and/or optional linker), or aderivative thereof.

In particular disclosed embodiments, the signaling conjugate has aminimum concentration, when covalently deposited on the sample, ofgreater than about 1×1011 molecules per cm2·μm or greater than about toabout 1×1013 molecules per cm2·μm within the biological sample. Inparticular disclosed embodiments, the concentration of signalingconjugate deposited ranges from about to about 1×1011 molecules percm2·μm to about to about 1×1016 molecules per cm2·μm.

Embodiments of the disclosed signaling conjugate can be made using thegeneral procedure illustrated in Scheme 1. In particular disclosedembodiments, the conjugate is formed without an optional linker. Forexample, a carboxylic acid moiety of the chromophore may be coupled witha tyramine molecule or tyramine derivative by first converting thecarboxylic acid to an activated ester and then forming an amide bondbetween the chromophore and the tyramine molecule or tyraminederivative. An exemplary method for making a signaling conjugate withouta linker is illustrated below in Scheme 2.

In embodiments wherein the linker is present, the carboxylic acid moietyof the chromophore may be coupled with an amine-terminated linker (e.g.,an alkylene oxide) by first converting the carboxylic acid to anactivated ester and then forming an amide bond between the chromophoreand the amine-terminated linker. The remaining terminus of the linkermay then be activated and subsequently coupled with a tyramine moleculeor tyramine derivative. An exemplary method for making the signalingconjugate is provided below in Scheme 2.

Exemplary signaling conjugates are provided below.

Amplifying Conjugates

Also disclosed herein are conjugates suitable for amplifying a signalobtained from carrying out the method disclosed herein. The amplifyingconjugates typically comprise a latent reactive moiety, a detectablelabel, and an optional linker.

The detectable label of the amplifying conjugate may be any detectablelabel provided herein. In particular disclosed embodiments, thedetectable label is a hapten, such as any of the haptens disclosedherein. Reference is made to U.S. Pat. No. 7,695,929, which disclosesstructures and synthetic approaches to making amplifying conjugates andtheir corresponding specific antibodies. In particular disclosedembodiments, a hapten having an electrophilic functional group (orhaving a functional group capable of being converted to an electrophilicfunctional group) is conjugated to the latent reactive moiety or to alinker, (e.g., an aliphatic or poly(alkylene oxide) linker). In certainembodiments, the hapten includes a carboxylic acid functional group,which is converted to an activated, electrophilic carbonyl-containingfunctional group, such as, but not limited to, an acyl halide, an ester(e.g., a N-hydroxysuccinimide ester), or an anhydride. The latentreactive moiety includes a nucleophilic functional group (e.g., amino,hydroxyl, thiol, or anions formed therefrom) capable of reacting withthe hapten's activated electrophilic functional group. The hapten'selectrophilic group can be coupled to the latent reactive moiety'snucleophilic group using organic coupling techniques known to a personof ordinary skill in the art of organic chemistry synthesis. Inembodiments where the conjugate includes a linker, the linker typicallyhas a nucleophilic functional group at one end and an electrophilicfunctional group at the other end. The linker's nucleophilic group canbe coupled to the hapten's electrophilic group, and the linker'selectrophilic group can be activated and coupled to the latent reactivemoiety's nucleophilic group using organic coupling techniques known to aperson of ordinary skill in the art of organic chemical synthesis.

In further illustrative embodiments, the signaling conjugate is used asan amplifying conjugate. The signaling conjugate can be used as anamplifying conjugate where the chromophore moiety is an effectivelabeling moiety. In illustrative embodiments, an antibody specific to achromophore moiety enables that chromophore moiety to serve as asignaling and labeling conjugate. From another perspective, a haptenwhich possesses physical attributes, as disclosed herein, for effectivechromophore moieties, may be used as both a chromophore moiety and as ahapten. There are particular benefits of using a signaling conjugate asan amplifying conjugate. In particular, the amplifying step would resultin the deposition of significant, e.g. potentially detectable, amountsof the chromophore moiety. As such, the subsequent chromogenic detectioncould be stronger. Similarly, as described herein with respect to mixingchromogens from different classifications, a unique color could begenerated using the overlap of absorbances from two or more chromophoremoieties.

VI. Compositions

An illustrative composition can be specimen including a biologicalsample and a plurality of signaling conjugates. In particular disclosedembodiments, the composition comprises a biological sample thatcomprises one or more enzyme-labeled targets for visualization. Theenzyme used to label the target may originate from a labeling conjugate,such as an enzyme conjugate. The composition also may further compriseone or more detection probes. The plurality of signaling conjugates areas disclosed herein and are configured to provide a bright-field signal.The plurality of signaling conjugates are covalently bound proximally toor directly on the one or more targets. In particular disclosedembodiments, configured to provide a bright-field signal compriseschoosing a particular chromogenic moiety for the signaling conjugatethat is capable of absorbing about 5% or more of incident light. Inparticular disclosed embodiments, about 20% of the incident light may beabsorbed.

The composition comprises a signaling conjugate that has been configuredto provide the particular wavelength maxima disclosed herein for thechromogenic moieties of the signaling conjugates. Solely by way ofexample, the signaling conjugate is configured to provide a bright-fieldsignal such that an absorbance peak having a λ_(max) as is disclosedherein. Two different absorbance peaks also may be obtained byconfiguring different signaling conjugates to comprise differentchromogenic moieties that have absorbance peaks of differing λ_(max)values, as disclosed herein. The composition also may comprise aplurality of signaling conjugates configured to provide a bright-fieldsignal by being selected as having a particular FWHM value. SuitableFWHM values are disclosed herein. In other disclosed embodiments, atleast a portion of the plurality of signaling conjugates has an averagemolar absorptivity selected from the particular values provided herein.

Particular disclosed embodiments of the composition also concern aplurality of signaling conjugates that have a particular solubility inwater, such as those values provided herein. Also, the plurality ofsignaling conjugates also may be stable in an aqueous buffer solutionfor the period of time provided herein.

In particular disclosed embodiments, the composition comprises aplurality of signaling conjugates that are configured to impart anoptically apparent color under bright-field illumination, such as red,orange, yellow, green, indigo, or violet. The optically apparent colormay also be a mixture, such as that a first optically distinct color, asecond optically distinct color, a third optically distinct color, afourth optically distinct color, and even a fifth optically distinctcolor may be obtained and visualized.

The biological sample present in the disclosed composition can be atissue or cytology sample as is disclosed herein. In particulardisclosed embodiments, the biological sample may comprise two targets, afirst target and a second target and the composition may furthercomprise a first detection probe that is specific for the first targetand a second detection probe that is specific for the second target.

VII. Kits

Also disclosed herein are embodiments of a kit comprising the signalingconjugate for use with the imaging systems disclosed herein. In anotherembodiment, the kit includes a detection probe. In another embodiment,the kit includes a labeling conjugate. In another embodiment, the kitincludes a amplifying conjugate and a secondary labeling conjugate. Inanother embodiment, the kit may further comprise a peroxide solution. Inillustrative embodiments, the kit includes a detection probe. Inillustrative embodiments, the reagents of the kit are packaged incontainers configured for use on an automated slide staining platform.For example, the containers may be dispensers configured for use and aBENCHMARK Series automated IHC/ISH slide stainer.

In illustrative embodiments, the kit includes a series of reagentscontained in different containers configured to work together to performa particular assay. In one embodiment, the kit includes a labelingconjugate in a buffer solution in a first container. The buffer solutionis configured to maintain stability and to maintain the specific bindingcapability of the labeling conjugate while the reagent is stored in arefrigerated environment and as placed on the instrument. In anotherembodiment, the kit includes a signaling conjugate in an aqueoussolution in a second container. In another embodiment, the kit includesa hydrogen peroxide solution in a third container for concomitant use onthe sample with the signaling conjugate. In the second or thirdcontainer, various enhancers (e.g. pyrimidine) may be found forincreasing the efficiency by which the enzyme activates the latentreactive species into the reactive species. In a further embodiment, thekit includes an amplifying conjugate.

Kits can include wide range of cocktail assays, including the ULTRAVIEWSISH Detection Kit (Ventana Medical Systems, Inc., p/n 780-001), theINFORM HER2 DNA Probe (Ventana Medical Systems, Inc., p/n 780-4332), theRabbit Anti-DNP Antibody (Ventana Medical Systems, Inc., p/n 780-4335),the Rabbit Anti-HER2 (4B5) Antibody (Ventana Medical Systems, Inc., p/n800-2996), the ULTRAVIEW Universal Alkaline Phosphatase Red DetectionKit (Ventana Medical Systems, Inc., p/n 760-501), the silver wash(Ventana Medical Systems, Inc., p/n 780-002), and/or the INFORMChromosome 17 Probe (Ventana Medical Systems, Inc., p/n 780-4331).Another cocktail assay is the INFORM HER2 Dual ISH DNA Probe sold by(Ventana Medical Systems, Inc.), which includes the INFORM HER2 Dual ISHDNA Probe Cocktail (Ventana Medical Systems, Inc., p/n 800-4422), theHybReady (Ventana Medical Systems, Inc., p/n 780-4409), the ultraViewSISH DNP Detection Kit (Ventana Medical Systems, Inc., p/n 800-098), theultraView Red ISH DIG Detection Kit (Ventana Medical Systems, Inc., p/n800-505), the ultraView Siler Wash II (Ventana Medical Systems, Inc.,p/n 780-003), and/or the HER2 Dual ISH 3-in-1 Xenograft Slides (VentanaMedical Systems, Inc., p/n 783-4332). Other cocktail assays can be used.Cocktail assays can be used to quantitatively detect amplification ofthe HER2 gene via two color chromogenic ISH in formalin-fixed,paraffin-embedded tissue specimens of human breast cancer and gastriccancer, including the gastro-oesophagal junction and can be an aid inthe assessment of patients for whom Herceptin (trastuzumab) may be atreatment option. In yet other protocols, the cocktail assay is theVENTANA HER2 DNA Probe Assay sold by Ventana Medical Systems, Inc., p/n800-4422. U.S. patent application Ser. No. 11/809,024 (corresponding toU.S. Patent Publication No. 2008/299555) entitled MULTICOLOR CHROMOGENICDETECTION OF BIOMAKERS and U.S. patent application Ser. No. 11/809,024(corresponding to U.S. Patent Publication No. 2011/0136130) entitledMETHOD FOR CHROMOGENIC DETECTION OF TWO OR MORE TARGET MOLECULES IN ASINGLE SAMPLE disclose substances, protocols, and specimen processingtechniques and are incorporated by reference in their entireties. Otherassays or cocktails can also be used.

In some embodiments, a tissue sample processed according to an ISHprotocol. The ISH protocol can provide visualization of specific nucleicacid sequences (e.g., DNA, mRNA, etc.) in frozen tissue sections,fixed/paraffin embedded tissue sections, or other cell preparations byhybridizing complementary strands of nucleotides (e.g., probes) to thesequence of interest. The ISH protocol can include, without limitation,a dual SISH and Red ISH protocol, single Red ISH protocol, single SISHprotocol, or the like. To determine a HER2/chromosome 17 ratio in breasttissue, the imaging apparatus 112 of FIG. 1 can capture images thatinclude silver in situ hybridization signals, red in situ hybridizationsignals, or the like. Digitally enhanced images/video can be producedbased on the images and viewed on the display. The tissue is scoredbased on the signals corresponding to HER2 genes and chromosome 17s todetermine the HER2/CR17 ratio. Based on the ratio, the specimen's HER2gene is determined to be amplified or not amplified. To automaticallyscore the breast tissue sample, candidate nuclei can be selected forquantitative analysis. The processing device 122 of FIG. 1 canautomatically counts different features (e.g., HER2 genes, chromosome17s, etc.) and determines the ratio of the number of features.Additional nuclei can be scored. A diagnosis can be made based, at leastin part, on the ratios. Results can be displayed on the display 114 ofFIG. 1. To evaluate whether the tissue sample (e.g., breast tissue) is acarcinoma, the processing device 122 of FIG. 1 can assist the user inobtaining information about the selected region by, for example,detecting the amplification of genes by evaluating the ratio of thenumber of HER2 gene signals to the number of chromosome 17 signals.

VIII. Conclusion

The technology disclosed herein can be used on different types ofbiological samples. Biological samples can be a tissue sample or samples(e.g., any collection of cells) removed from a subject. The tissuesample can be a collection of interconnected cells that perform asimilar function within an organism. A biological sample can also be anysolid or fluid sample obtained from, excreted by, or secreted by anyliving organism, including, without limitation, single-celled organisms,such as bacteria, yeast, protozoans, and amebas, multicellular organisms(such as plants or animals, including samples from a healthy orapparently healthy human subject or a human patient affected by acondition or disease to be diagnosed or investigated, such as cancer).In some embodiments, a biological sample is mountable on a microscopeslide and includes, without limitation, a section of tissue, an organ, atumor section, a smear, a frozen section, a cytology prep, or celllines. An incisional biopsy, a core biopsy, an excisional biopsy, aneedle aspiration biopsy, a core needle biopsy, a stereotactic biopsy,an open biopsy, or a surgical biopsy can be used to obtain the sample.

The biological samples can be carried by standard microscope slide madeof glass, such as borosilicate glass (e.g., BK7 glass). The slide canhave a length of about 3 inches (75 mm), a width of about 1 inch (25mm), and a thickness of about 1 mm. Slides made of different materialsand with different dimensions can be used. Coverslips can also be madeof glass (e.g., borosilicate glass) or other optically transparent orsemi-transparent materials (e.g., plastics or polymers). Both the slide(e.g., slide 134 of FIG. 3) and coverslip (e.g., coverslip 139 of FIG.3) can be substantially flat substrates. The term “substantially flatsubstrate” refers, without limitation, to any object having at least onesubstantially flat surface, but more typically to any object having twosubstantially flat surfaces on opposite sides of the object, and evenmore typically to any object having opposed substantially flat surfaces,which opposed surfaces are generally equal in size but larger than anyother surfaces on the object. The imaging systems and techniques can bemodified for use with other types of specimen carriers.

The imaging systems disclosed herein can utilize different types ofmultispectral images by re-defining the spectral characteristics ofimages such that the targeted features are optimally perceived by theobserver. For example, color re-definition and/or contrast enhancementcan be performed to better visually distinguish each target feature andadapt to the observers color acuity. In embodiments, the image capturedevice 120 of FIG. 1 is a multispectral camera, and the processingdevice 122 of FIG. 1 can perfrom spectral unmixing of colors, or similartechniques, as part of re-definition to provide optimal colorseparation. The spectral unmixing of colors can be performed using knownunmixing algorithms, including, without limitation, the apparatuses,algorithms, and methods disclosed in U.S. Pat. No. 8,285,024 and PCTApp. PCT/EP2012/058253 (PCT Pub. No. WO2012/152693), which are herebyincorporated by reference in their entireties. Additionally,tissue-based analyses, cell-based analyses, or other types of analysescan be performed on the unmixed images. One or more of the unmixedimages can be re-defined and two or more of the unmixed images can becombined to produce one or more enhanced images (e.g., false colorcomposite images).

All of the U.S. patents, U.S. patent application publications, U.S.patent applications, foreign patents, foreign patent applications andnon-patent publications referred to in this specification and/or listedin the Application Data Sheet are incorporated herein by reference, intheir entirety. Aspects of the embodiments can be modified, if necessaryto employ concepts of the various patents, applications and publicationsto provide yet further embodiments. For example, U.S. Provisional PatentApplication No. 61/616,330, filed on Mar. 27, 2012, U.S. ProvisionalPatent Application No. 61/710,607, filed on Oct. 5, 2012, and U.S.Provisional Patent Application No. 61/778,093, filed on Mar. 12, 2013are all incorporated herein by reference in their entireties.

In view of the many possible embodiments to which the principles of thedisclosed invention may be applied, it should be recognized that theillustrated embodiments are only preferred examples of the invention andshould not be taken as limiting the scope of the invention. Rather, thescope of the invention is defined by the following claims. We thereforeclaim as our invention all that comes within the scope and spirit ofthese claims.

What is claimed is:
 1. A system for generating a multicolor video of asample on a microscope slide, comprising: at least one processor; andmemory storing program instructions that, when executed by the at leastone processor, cause the system to: cause a plurality of light sourcesto output different light wavebands at different times to sequentiallyilluminate the sample, wherein the plurality of light sources includesone or more of an ultraviolet light source or an infrared light source,receive a first image of the sample exposed to a first light wavebandfrom a first light source of the plurality of light sources, wherein thefirst light waveband is configured to interact with a first chromogenbound to a first component of the sample, receive a second image of thesample exposed to a second light waveband from a second light source ofthe plurality of light sources, wherein the second light waveband isconfigured to interact with a second chromogen bound to a secondcomponent of the sample, the second light waveband being different fromthe first light waveband, generate an enhanced color composite image ofthe sample based on the first and second images by selecting a falsecolor for at least one of the first or second chromogens, such thatcolor contrast between the first and second components in the enhancedcolor composite image is increased compared to natural color contrastbetween the first and second components in the first and second images,and output the enhanced color composite image as part of a real-timevideo of the sample.
 2. The computer-based imaging system of claim 1,wherein the plurality of light sources includes both the ultravioletlight source and the infrared light source.
 3. The system of claim 1,wherein the first light source is the ultraviolet light source or theinfrared light source.
 4. The system of claim 1, further comprising: anilluminator including the plurality of light sources; and an imagingdevice configured to capture the first and second images.
 5. The systemof claim 4, wherein the plurality of light sources are pulsed lightsources, and wherein the imaging device is synchronized with pulsing ofthe pulsed light sources.
 6. The system of claim 4, wherein theplurality of light sources include a plurality of LEDs.
 7. The system ofclaim 1, wherein: in the first image, the sample is exposed only to thefirst light waveband from the first light source; and in the secondimage, the sample is exposed only to the second light waveband from thesecond light source.
 8. The system of claim 1, wherein the instructionsfurther cause the system to convert one or more of the first image orthe second image into a false color image.
 9. The system of claim 8,wherein the instructions further cause the system to: convert the firstimage to a first false color image; and convert the second image to asecond false color image.
 10. The system of claim 9, wherein theenhanced color composite image is generated by combining the first andsecond false color images.
 11. The system of claim 1, wherein theinstructions further cause the system to capture at least two additionalimages of the sample exposed to at least two additional light wavebands,wherein the enhanced color composite image is generated based on thefirst image, the second image, and the at least two additional images.12. The system of claim 11, wherein the first image, the second image,and the at least two additional images are each converted into falsecolor images.
 13. A method for producing a multicolor video of a sample,the method comprising: capturing a first image of the sample exposed toa first light waveband from a first light source, the first lightwaveband being an ultraviolet waveband or an infrared waveband, whereinthe sample includes a first feature stained with a first chromogenconfigured to absorb the first light waveband; capturing a second imageof the sample exposed to a second light waveband from a second lightsource, the second light waveband being different from the first lightwaveband, wherein the sample includes a second feature stained with asecond chromogen configured to absorb the second light waveband;producing a digitally-enhanced multicolor image of the sample from thefirst and second images by converting at least one of the first orsecond images into a false color image, such that color contrast betweenthe first and second features in the digitally-enhanced multicolor imageis increased compared to natural color contrast between the first andsecond features in the first and second images, and outputting amulticolor video including the digitally-enhanced multicolor image,wherein the multicolor video is configured to be displayed at a framerate greater than or equal to 2 frames per second.
 14. The method ofclaim 13, wherein the first image is captured while the sample is notexposed to the second light waveband from the second light source, andthe second image is captured while the sample is not exposed to thefirst light waveband from the first light source.
 15. The method ofclaim 13, wherein the capturing of the first and second images isperformed without using filters.
 16. The method of claim 13, wherein thefirst and second light sources are different pulsed light sources, andwherein capturing the first and second images includes sequentiallypulsing the different pulsed light sources.
 17. The method of claim 16,wherein the different pulsed light sources are different color LEDs. 18.The method of claim 13, wherein the multicolor video is configured to bedisplayed at a frame rate greater than or equal to 30 frames per second.19. The method of claim 13, wherein the first chromogen is covalentlybound to the first feature and the second chromogen is covalently boundto the second feature.
 20. The method of claim 13, further comprisingcapturing two or more additional images of the sample exposed to two ormore additional light wavebands, wherein the digitally-enhancedmulticolor image is produced based on the first image, the second image,and the two or more additional images.